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Abstract 


In  recent  years  there  has  been  a  marked  increase  in  the  emphasis  and  expectations  for 
school  and  program  evaluations.  Administrators  and  boards  need  assurance  that  their 
models  of  school  and  program  evaluation  are  consistent  with  increased  effectiveness 
and  school  improvement  as  a  result  of  the  investments  of  professional  time,  expertise, 
and  budget  dollars. 

The  purpose  of  the  Lethbridge  School  District  No.  51  Project  was  to  develop  a  more 
effective  model  for  system,  school,  and  program  evaluation. 

A  review  of  the  literature  indicated  that  a  collaborative  model  for  school  and  program 
evaluation  would  be  more  effective.  In  previous  models,  teachers  and  school-based 
administrators  were  not  actively  involved  in  the  process  and  hence  gained  little  from 
the  exercise.  The  collaborative  model  resulted  in  the  empowerment  of  school-based 
personnel  through  active  involvement. 

The  use  of  educational  quality  indicators  served  as  a  key  component  in  the 
development  of  the  model.  Current  literature  and  input  from  established  program 
sub-committees  and  stakeholder  groups  were  used  to  develop  characteristics  or 
criteria,  in  terms  of  indicatorsof  effectiveness,  quality,  and  improvement 

The  result  has  been  the  development  of  a  model  for  schools  to  evaluate  their  own 
educational  quality  and  effectiveness  in  a  professional  manner.  This  serves  to 
empower  staff  to  contribute  to  meaningful  and  effective  school  growth  and 
improvement. 

The  findings  from  the  initial  study  were  applied  to  development  of  an  evaluation  of 
the  art  and  library  programs.  The  final  stage  of  the  project  focused  on  the  art  program 
and  resulted  in  the  identification  of  input,  process,  and  outcome  indicators  of  program 
effectiveness.  Assessment  processes  to  measure  and  verify  outcomes  were  identified 
or  developed.  The  generic  model  that  was  developed  could  be  applied,  with  few 
modifications,  to  most  program  areas. 

As  a  result  of  the  research  project,  it  has  been  determined  that  the  former  model  of 
program  and  school  evaluation  utilized  in  Lethbridge  School  District  No.  51  was 
not  consistent  with  the  literature  on  indicators  of  effectiveness,  quality,  and  school 
improvement.  A  collaborative  model  for  school/program  evaluations,  in  which  the 
use  of  "educational  quality  indicators"  is  a  key  component,  is  more  effective. 


iv 


Table  of  Contents 


Chapter  Page 

1   Introduction  1 

Background  2 

Purpose  3 

Assumptions  3 

Definitions  4 

Design  5 

Delimitations  8 

Limitations  8 

Overview  9 


2   Related  Literature  10 

Meta-Evaluation:  Evaluating  the  Evaluation  10 

Effective  Schools  Research  12 

Indicators  of  Effectiveness  or  Quality  1 3 

School  Improvement  14 

External  versus  Internal  Evaluation  1 5 

Application  to  the  Art/Library  Program  Evaluation  Models  1 6 


3   DiBsign  18 
Evaluation  of  the  Former  Model  1 8 

Change  of  Focus  21 


4   Development  of  the  Model  24 

1991  Art  and  Library  Evaluations  24 

Purposes  24 

Procedures  24 

Discussion  26 

Findings  26 


5  A  Collaborative  Model  for  School  and  Program  Evaluation  29 

Application  to  Lethbridge  School  District  No.  51  School  and  30 
Program  Evaluations 

6  Summary  and  Discussion  34 

Rationale  34 

Purpose  35 

Design  36 

Findings  37 

The  Art  Program  Model  38 

Implications  39 

Recommendations  39 

Follow-up  40 

Closing  Statement  40 


V 


References 


41 


Appendices  45 

A       Project  Teams  46 

B        Art  Program  Evaluation  Questionnaires  48 

C       Art  Program  Questionnaire  Data  58 

D       Library  Program  Evaluation  66 

E       Sample  Assessment  Instruments  74 


vi 


List  of  Tables 


Table  Page 

1  Response  Rate  for  the  Art  and  Library  Program  Evaluations  7 

2  Common  Questions  for  Respondent  Groups  in  the 

1991  Art  Evaluation  26 

List  of  Figures 

Figure  Page 

1  Art  Program  Evaluation  Flow  Chart  23 

2  A  Collaborative  Model  for  Art  Program  Evaluation  3 1 

3  Results-Based  Art  Program  Plan  32 


vi± 


Chapter  1 


Introduction 

In  recent  years  there  has  been  a  marked  increase  in  the  emphasis  and  expectations 
for  school  and  program  evaluations.  Throughout  much  of  Alberta,  the  approach 
used  has  been  predominandy  a  "top  down"  process  with  the  planning  and 
procedures  carried  out  almost  exclusively  by  personnel  from  Alberta  Education  or 
district  central  offices  with  assistance  by  external  resource  persons.  A  meta- 
evaluation,  conducted  by  Lethbridge  School  District  No.  51,  concluded  that  limited 
changes  were  being  realized  by  the  evaluations.  Teachers  and  school-based 
administrators  were  not  actively  involved  and  hence  gained  little  from  the  exercise. 
A  study  of  the  related  literature  and  procedures  used  in  other  locations  led  to  the 
development  of  a  "collaborative  model"  to  empower  school-based  personnel  to  be 
actively  and  professionally  involved  in  their  school  and  program  evaluations.  The 
use  of  "educational  quality  indicators"  served  as  a  key  component  of  the  model. 

Introduction 

In  collaboration  with  twelve  Alberta  school  jurisdictions,  the  objective  of  the 
Alberta  Education  Educational  Quality  Indicators  (EQI)  initiative  was  to  develop 
indicator  systems  to  measure  the  success  of  the  educational  enterprise  in  the 
province.  Indicators  provide  information  to  assist  in  assessing  the  quality  of 
educational  programs  and  the  delivery  system  by  focusing  on  student  outcomes. 
The  EQI  initiative  focused  on  developing  indicator  systems,  establishing 
procedures,  and  reporting  and  disseminating  the  information  to  educational 
constituencies  in  Alberta. 

In  recent  years,  evaluation  of  teaching  and  of  teachers  has  received  in-depth  study 
but  litde  effort  seems  to  have  been  put  into  whether  the  models  and  procedures  used 
for  the  relatively  new  focus  on  school  and  program  evaluations  are  consistent  with 
the  findings  of  educational  research.  Because  the  stated  goal  of  evaluation  is  almost 
always  school  improvement,  there  is  a  need  to  consider  and  utilize  the  research  on 
quality  indicators,  school  effectiveness,  and  school  improvement.  A  collaborative 
model  should  ensure  a  "buy  in"  by  those  involved.  This  is  most  important  as 
evaluation  alone  does  not  cause  improvement. 
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In  the  province  of  Alberta,  as  in  other  Canadian  provinces,  and  a  number  of 
American  states,  there  has  been  an  increasing  emphasis  and  expectation  from 
governments  that  school  jurisdictions  develop  and  carry  out  formalized  procedures 
for  evaluation,  including  the  evaluation  of  students,  teachers,  programs,  schools, 
and  school  systems. 

Background 

Administrators  and  boards  need  assurance  that  their  models  of  school  and  program 
evaluation  are  consistent  with  increased  effectiveness  and  school  improvement  as  a 
result  of  the  investments  of  professional  time,  expertise,  and  budget  dollars. 
Stufflebeam  and  Shinkfield  (1985)  affirmed  that  if  evaluations  are  to  be  useful  and 
provide  proper  direction  and  guidance,  "the  evaluations  themselves  must  be  sound" 
(p.  183).  In  Lethbridge  School  District  No.  51,  and  indeed  throughout  much  of 
Alberta,  the  approach  used  has  been  predominantly  "top  down"  with  the  planning 
and  procedures  carried  out  almost  totally  by  personnel  from  the  district  central 
office  and  assisted  by  external  resource  persons.  A  meta-evaluation  concluded  that 
limited  outcomes  were  being  realized  by  the  evaluations  since  the  teachers  and 
school-based  administrators  were  not  actively  involved  (except  for  having  the 
process  "done  to"  them)  and  hence  gained  little  from  the  exercise.  A  study  of 
related  literature  and  of  procedures  employed  in  other  locations  led  to  the  proposal 
for  a  "collaborative  model"  and  empowering  school-based  personnel  to  be  actively 
and  professionally  involved  in  their  program  and  school  evaluations.  The  use  of 
"educational  quality  indicators"  serves  as  a  key  component. 

This  project  involved  carrying  out  a  case  study  of  the  model  of  school  and  program 
evaluation  employed  in  Lethbridge  School  District  No.  51  (LSD  No.  51),  a  mediimi- 
sized  southern  Alberta  jurisdiction  of  approximately  8,000  students  and  450 
professional  staff.  The  Lethbridge  model  involved  the  use  of  a  large  team  (as  many 
as  55  people)  from  the  school  district  central  office,  other  schools.  Alberta 
Education  offices,  other  school  district  central  offices  and  schools  and  the 
University  of  Lethbridge.  These  teams  would  spend  up  to  three  weeks  on  site  for 
the  school  evaluation  process.  A  common  concern  was  whether  the  model  (which 
was  extremely  expensive  in  terms  of  professional  time  and  expertise)  was 
producing  payoffs  in  professional  growth  and  development.  Perhaps  the  most 
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significant  concern  was  the  problem  of  implementing  the  recommendations 
emanating  from  the  evaluation  report;  members  of  the  district  support  staff 
(consultants,  coordinators,  and  superintendents)  were  so  heavily  involved  with 
preparing  for  and  carrying  out  the  evaluations  that  they  had  little  or  no  time  to 
provide  follow-up  or  assistance  with  implementing  the  recommendations  made. 

Purpose 

The  purpose  of  the  study  was  to  develop  a  collaborative  model  for  school  and 
program  evaluations  through  the  use  of  quality  indicators.  The  following  research 
questions  were  addressed  in  the  study: 

1 .  Is  the  current  Lethbridge  School  District  No.  51  model  for  program  and  school 
evaluation  consistent  with  the  literamre  on  indicators  of  effectiveness,  quality 
and  school  improvement? 

2.  Are  the  procedures,  instruments,  and  data  used  in  the  Lethbridge  School  District 
No.  51  model  valid  and  reliable? 

3 .  Does  the  current  literature  suggest  characteristics  or  criteria  of  more  effective 
and  efficient  models  for  program  and  school  evaluation  in  terms  of  indicators  of 
effectiveness,  quality  and  improvement? 

4.  If  the  findings  for  the  above  indicate  "yes",  can  the  findings  be  applied  to  the 
development  of  a  collaborative  model  for  a  school  system  program  evaluation 
for  the  art  and/or  the  school  library  system? 

Assumptions 

1 .  The  model  for  school/program  evaluations  previously  used  was  judged  to  be 
moderately  effective  and,  although  it  was  perceived  as  resulting  in  some  school 
and  program  improvement,  it  was  subject  to  criticism  by  the  stakeholders. 

2 .  Art  programs  are  often  perceived  as  being  difficult  to  evaluate  for  several 
reasons:  little  research  is  available  in  this  area;  teachers,  particularly  elementary 
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teachers,  have  little  training/expertise  in  art  program  evaluation;  and  because 
there  has  been  a  general  feeling  that  this  evaluation  process  inhibits  children's 
creativity.  As  a  result  of  these  assumptions,  the  decision  was  made  that  the 
system  art  programs  would  be  one  of  the  programs  that  the  study  would 
involve. 

Definitions 

Educational  Indicator  System:  Indicators  provide  evidence  and/or  statistics 
that  inform  policy  makers  and  the  public  about  the  condition  of  the  educational 
system  and  how  it  is  changing.  Indicator  systems  have  a  wide  range  of  policy 
uses.  They  can: 

•  report  the  condition  of  the  educational  system  over  time 

•  compare  the  condition  of  the  system  with  other  localities 

•  determine  the  system's  progress  in  attaining  certain  specified  goals 

•  assess  the  implementation  of  education  reform  policies  by  local  school 
districts 

•  evaluate  the  impact  of  policy  changes  on  the  system 

•  identify  potential  problems  in  the  educational  system 

•  explain  the  causes  of  various  conditions  and  changes 

•  hold  teachers,  schools  and/or  school  districts  accountable  for  student 
performance  (Goertz  &  King,  1989,  p.  23) 

Quality  Indicators:  These  are  observable  characteristics  of  excellence  established 
through  consensus  of  professional  judgement  among  practicing  teachers  (Calgary 
Board  of  Education  and  Calgary  Catholic  Board  of  Education).  They  specify  the 
information  that  is  used  to  determine  the  result  achieved  for  each  sub-goal. 

System  Inputs/Teacher  Inputs:  Human  and  financial  resources  available  to 
education. 

Processes:  What  is  taught  and  how  it  is  taught. 

Outputs:  These  are  identified  as  consequences  of  schooling  on  students  from 
different  backgrounds. 
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student  Outcomes:  What  follows  as  a  result  of  the  inputs  and  processes 
involved  in  a  student's  educational  development.  These  may  be  cognitive,  affective 
or  behavioral  outcomes  and  may  be  recorded  as  desired  or  as  actual  outcomes. 

Evaluation  Processes:  Measurement  of  the  actual  outcomes  can  be  achieved 
through  observation  (of  participation,  cooperation,  attitude,  focus  on  task, 
initiative,  organization,  etc.),  examination  (projects,  portfolios,  sketchbooks,  etc. 
for  which  specific  evaluation  criteria  have  been  established),  interviews  (one-on 
-one,  group,  conference),  surveys,  questionnaires,  diagnostic  testing,  and 
evaluation  (by  criteria,  impressionistic/holistic  scoring,  teacher  directed,  student 
directed). 

Impressionistic  Scoring:  Strategies  for  developing  criteria  for  subjective 
evaluation  which  allow  for  obtaining  more  results  in  less  time.  Impressionistic 
scoring  may  be  used  at  all  grade  levels  and  for  all  subjects. 

Collaborative  Model:  One  which  empowers  school-based  personnel  to  be 
actively  and  professionally  involved  in  school  and  program  evaluations. 

Portfolio:  A  purposeful,  integrated  collection  of  student  work  that  shows  student 
effort,  progress,  or  achievement  in  one  or  more  areas.  The  collection  includes 
evidence  of  student  self-reflection  and  participation  in  setting  the  focus,  selecting 
contents,  and  judging  merit  Activities  are  guided  by  standards.  A  portfolio 
communicates  what  is  learned  and  why  it  is  important. 

Design 

This  project,  which  took  place  over  a  three  year  period,  was  designed  to  identify 
and/or  develop  a  better  model  for  school  and  program  evaluations. 

The  collaborative  model  developed  by  Lethbridge  School  District  No.  51, 
encompasses  an  internal  evaluation  of  school/program  effectiveness  by  key 
members  within  the  school  community,  namely,  the  administrative  team  teachers, 
students,  and  parents.  In  addition,  the  model  has  an  external  team  independently 
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validate  the  self-evaluation  of  the  school  community  through  data  collection, 
interviews,  etc. 

During  the  second  year  of  the  project,  a  model  for  evaluating  two  programs  was 
undertaken.  The  school  library  program  and  the  art  program  were  selected  to  apply 
to  the  collaborative  model  and  quality  indicator  research  about  evaluation  and  the 
use  of  indicators  of  effectiveness  and  quality. 

Two  system  coordinating  committees  were  struck  to  determine  the  indicators  of 
effectiveness  of  the  two  programs.  Membership  came  from  various  stakeholder 
groups  representative  of  the  school  community-parents,  students,  teachers,  and 
administrators.  Each  committee  was  asked  these  basic  questions: 

1 .  What  do  you  think  would  be  some  of  the  indicators  of  an  effective  and 
successful  library  (art)  program? 

2.  What  would  be  happening  in  a  successful  library  (art)  program? 

3 .  What  outcomes  would  tell  us  if  the  (library/art)  program  was  highly  successful 
and/or  effective? 

An  appointed  project  leader  for  each  program  evaluation  worked  with  the 
committees  in  clarifying,  classifying,  categorizing,  and  refining  the  indicators 
generated  by  the  local  coordinating  teams. 

Some  of  the  indicators  of  highly  successful  and  effective  library/art  programs  were 
identified  in  the  literature  and  shared  with  the  steering  committee.  From  the  list  of 
indicators  generated  from  the  literature  and  through  brainstorming,  questioimaires 
were  developed  for  the  self-evaluation  instrument  to  be  used  by  the  target  groups 
within  the  school  community-teachers  (teacher-librarians),  administrators, 
students,  and  parents.  The  information  from  the  questioimaire  comprised  the 
internal  evaluation  segment  of  the  program  evaluation.  Each  group  had  items  that 
cross-referenced  the  items  on  the  other  groups'  questiormaire  so  that  perceptions  or 
comparisons  could  be  made  among  or  between  the  groups.  The  questioimaire 
required  response  ratings  to  reveal  the  degree  of  satisfaction  with  a  program  element 
or  responses  about  the  existence  or  non-existence  of  a  component  of  the  program, 
whether  it  be  in  the  form  of  resources  (himian  or  material),  instructional  planning, 
etc. 
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The  self-evaluation  questionnaire  was  completed  by  all  stakeholder  groups  within  a 
two-to-three  week  period  and  the  results  were  sent  to  the  central  office  where  the 
results  were  tabulated  for  each  respondent  group.  Both  school-based  results  and 
total  system  results  were  compiled  and  made  available  to  the  external  evaluation 
team  which  visited  all  schools  as  a  team,  interviewed  students,  teachers  and 
administrators,  and  visited  classrooms,  looking  at  resources  and  other  sources  of 
evidence  to  support  the  results  of  the  school-based  self-evaluation. 

Initially,  questionnaires  for  the  Art  and  Library  Program  Evaluations  were 
distributed  to  100  teachers/administrators,  1,700  parents  (1-6),  500  parents 
(secondary),  3,100  elementary  students,  and  1,275  secondary  students.  Table  1 
presents  the  response  rate  for  each  questionnaire. 

Table  1 

Response  Rate  for  the  Art  and  Library  Program  Evaluations 


Questionnaire  Distribution        Respondents         %  Response 


Art  Program  Evaluation 

Teachers/Administration          100  94  94.0 

Parents  (1-6)                    1,000  918  91.8 

Students  (1-3)                     850  811  95.4 

Students  (4-6)                    900  872  96.9 

Parents  (7-12)                    300  256  85.3 

Students  (7-12)                 JOO  378  94.5 

3,550  3,329  93.8 

Library  Program  Evaluation 

Elementary  parents                700  598  85.4 

Secondary  parents                200  156  78.0 

Elementary  students            1,350  1,265  93.7 

Secondary  students               875  839  95.9 

3,125  2,858  91.5 
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Following  the  compilation  of  the  data,  the  results  were  analyzed.  The  external  team 
compared  the  evidence  it  gathered  with  the  perceptions  of  the  school  community.  It 
also  drew  some  conclusions  about  the  quality  of  the  evaluated  program  for  the 
entire  system.  A  status  report  on  the  effectiveness  of  the  art/library  programs 
within  the  school  district  was  written  and  presented  to  the  Board  of  Trustees.  In 
addition,  the  committee  made  the  necessary  corrections/revisions  to  the  model,  and 
the  project  leader  developed  a  school-based  report  to  share  with  each  school.  This 
report  showed:  the  perception  of  the  school  program  from  the  perspective  of  the 
various  stakeholder  groups  in  relation  to  the  indicators  of  effectiveness;  the  findings 
of  the  extemal  team  in  the  form  of  commendations  and  recommendations;  and  the 
system  program  evaluation  data.  At  this  time  a  plan  of  action  for  schools  was 
initiated. 

Delimitations 

1 .  Only  the  art  and  library  programs  were  evaluated. 

2.  Only  one  class  at  each  grade  level  in  each  school  was  surveyed.  This  decision 
was  reached  by  the  art  committee  who  recognized  that  there  was  insufficient 
staff  available  to  tabulate  and  analyze  a  total  system  survey. 

Limitations 

The  lack  of  training  and  experience  of  the  project  leaders  in  data  collection  and 
analyses  procedures  were  cause  for  concern  in  the  early  stages  of  the  art  and  library 
program  evaluations.  The  data  analysis  was  further  hampered  by  the  loss  of  much 
of  the  information  collected  from  the  surveys.  This  loss  precluded  any  further 
analyses  of  the  data. 

A  change  of  personnel  during  the  second  year  of  the  project  resulted  in  some 
valuable  time  being  lost  while  the  staff  assuming  the  responsibility  responded  to 
their  new  role.  By  the  time  focus  and  direction  were  reestablished  there  was  a 
general  feeling  that  timelines  were  short  for  the  completion  of  the  project  The 
services  of  a  person  experienced  in  statistical  analysis  would  have  been  an  asset  to 
the  project  and  would  have  assisted  not  only  in  saving  valuable  time  but  also  in  the 
preparation  and  presentation  of  statistics  to  validate  the  report 
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Overview 

This  first  chapter  has  presented  background  information  on  the  purpose  of  the 
study,  some  assumptions,  definitions,  and  the  design  of  the  project  with  some 
delimitations  and  limitations  included. 

An  overview  of  the  related  literature  used  in  both  the  initial  research  component  of 
the  project  as  well  as  the  literature  relevant  to  the  specific  programs  is  presented  in 
Chapter  2. 

Chapter  3  presents  the  major  data  source,  collection  procedures,  and  data  analysis. 
Chapter  4  describes  the  case  study  research,  the  application  to  the  art  program  and, 
the  application  to  the  library  program.  A  comprehensive  description  of  each  is 
included.  The  results  of  the  studies  are  discussed  in  Chapter  5. 

Chapter  6  presents  the  summary  and  discussion.  It  reviews  the  purposes  and 
findings  of  the  project  and  discusses  what  conclusions  can  be  drawn  and  the 
implications  of  the  product.  Also  included  in  this  chapter  is  the  proposed  follow-up 
by  Lethbridge  School  District  No.  51  in  regard  to  further  development  and 
application  of  the  project. 
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Chapter  2 
Related  Literature 

Wamica  reviewed  four  major  areas  of  educational  literature  which  formed  the  basis 
for  his  study  and  proposed  model:  school  and  program  evaluation  -  theory  and 
practice,  effective  schools  research,  indicators  of  effectiveness  or  quality,  school 
improvement  literature,  and  evaluation  models,  criteria,  and  standards. 

Purposes  of  school  and  program  evaluations  were  clearly  stated  by  Stufflebeam 
(1971)  as  "not  to  prove  but  to  improve!"  The  literature  reviewed  revealed 
consistency  in  the  view  that  schools  and  programs  should  be  evaluated.  Both 
Eisner  (1985)  and  Goodlad  (1984)  stressed  the  lack  of  public  confidence  in  our 
schools.  Common  ( 1987)  concluded:  "There  is  rightfully  a  justification  for  careful 
evaluation  of  the  curriculum,  the  professionals  and  students,  and  the  organization 
that  constitutes  public  education"  (p.  15).  In  considering  the  nature  of  the 
evaluations  and  what  should  take  place,  Stufflebeam  and  Shinkfield  (1985)  reported 
that  Ralph  W.  Tyler,  who  is  generally  recognized  as  the  founder  of  educational 
evaluation,  considered  that  evaluation  should  determine  the  congruence  between 
performance  and  objectives.  This  approach  laid  the  foundations  for  an  objective- 
oriented  style  of  evaluation. 

Meta-E valuation:  Evaluating  the  Evaluation 

Scriven  (1976)  and  Stufflebeam  (1971)  discussed  "meta-evaluation"  and  the  need 
for  assessing  evaluation  criteria,  processes,  and  techniques.  Scriven  (1976) 
stressed  the  fact  that  evaluators  have  a  professional  obligation  to  ensure  that  their 
evaluations  are  subjected  to  competent  evaluation.  Scriven  viewed  evaluation  as 
involving  multiple  dimensions  and  employing  multiple  perspectives,  utilizing 
multiple  levels  or  measurement  and  making  use  of  multiple  methods. 

Morgan  (1986)  asserted  that  no  one  should  be  immune  from  evaluation.  Levin 
(1983)  concurred  and  noted,  "Given  the  amount  of  time,  effort,  and  money  which 
may  be  involved  in  an  evaluation,  and  the  importance  which  its  results  may  have, 
school  districts  need  to  be  sure  that  evaluations  do  'deliver  the  goods'"  (p.  35). 
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Common  (1987)  identified  a  number  of  concems  about  evaluation  as  it  is  now 
done.  She  opposed  external  models  for  evaluation  because  they  are  costiy, 
contentious,  lower  teacher  morale,  and  generate  data  which  may  be  used  very  little. 
Her  view  is  that  external  models  of  evaluation  may  stop  curriculum  innovation  and, 
at  best,  are  unlikely  to  make  it  start  (pp.  11-15). 

Stufflebeam  and  Shinkfield  (1985)  reported  that  Tyler  considered  that  evaluation 
should  determine  the  congruence  between  performance  and  objectives.  This 
approach  laid  the  foundation  for  an  objective-style  of  evaluation  as  far  back  as  1942 
(pp.  70-74). 

In  considering  the  "how"  of  evaluation,  Eisner  (1979)  expressed  his  strong  view 
that  procedures  and  criteria  used  to  evaluate  students,  teachers,  and  school 
administrators  "have  profound  effects  on  the  content  and  form  of  schooling".  He 
seemed  to  lend  considerable  support  to  the  argument  for  school-based  evaluation 
with  his  statement,  "The  school  is  the  basic  unit  of  educational  excellence"(p.  267). 
Goodlad  (1984)  offered  some  related  strategic  advice  when  he  stated  the  "efforts  at 
improvement  must  encompass  the  school  as  a  system  of  interacting  parts,  each 
affecting  the  others"  (p.  86). 

Herman  (1986)  suggested  a  model  involving  a  "top-down,  bottom-up"  approach. 
She  noted  the  main  problem  with  existing  "top-down"  models  was  that  the  people  at 
the  bottom  (teachers  and  local  administrators)  were  seen  as  data  providers  rather 
than  data  users  and  that  paperwork  and  bureaucratic  burdens  intruded  into,  rather 
than  supported,  school  operations  and  improvement  efforts.  "Bottom-up"  needs 
were  not  being  met 

Toffler  (1980)  and  Eisner  (1985)  provide  compelling  reasons  for  a  model  which 
involves  more  active  and  professional  participation  of  school-based  personnel.  The 
empowerment  of  school-based  teachers  and  administrators,  and  the  school  as  the 
focus  of  action  and  development  offer  the  greatest  potential  for  real  growth  and 
development  of  the  school,  its  staff,  and  its  programs  for  students. 
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Effective  Schools  Research 

To  a  certain  extent,  research  on  effective  schools  had  its  origin  somewhat  in 
response  to  the  well-publicized  works  of  Coleman  (1966)  and  Jencks  (1973).  They 
held  a  very  pessimistic  view  that  schools  could  do  very  litde  to  reduce  apparent 
inequality  among  children  in  terms  of  achievement 

Edmonds  (1979)  showed  that  some  schools  succeed  where  others  fail  and  identified 
five  characteristics  of  successful  schools:  principals  who  provide  strong 
administrative  and  instructional  leadership,  high  expectations  that  all  students  can 
and  will  learn,  a  school  climate  that  stimulates  learning,  students  and  staff  who 
believe  basic  skills  are  urgendy  important,  and  a  continuous  system  of  monitoring 
student  progress.  The  major  importance  of  school  leadership  was  reiterated  by  both 
Goodlad  (1984)  and  Rutter,  Maughan,  Mortimer,  Ouston,  and  Smith  (1979).  Over 
the  decade  of  the  1980s,  a  body  of  literature  known  as  "effective-schools  research" 
developed,  producing  a  remarkably  consistent  set  of  findings.  Purkey  and  Smith 
(1983),  after  a  wide  review  of  studies,  concluded  that  the  findings  of  recent  school- 
effects  research  contradict  the  conclusions  of  Coleman  (1966),  Jencks  (1973),  and 
others.  Schools  can  make  a  difference.  Wamica  (1990),  after  a  thorough  review  of 
the  literature,  and  based  on  lengthy  career  experiences,  concluded  that  the  decision 
on  the  debate  related  to  the  external  versus  intemal  evaluation  model  falls  clearly  on 
the  side  of  the  school-based  model.  The  convincing  arguments  of  Bond  and 
Donovan  (1982)  and  Common  (1987)  strongly  supported  this  conclusion. 

Of  significant  interest  is  that  not  all  researchers  and  writers  on  the  topic  are 
committed  to  the  effective  school  philosophy;  some  criticisms  have  emerged. 
GUckman  (1987)  argued  that  schools  and  researchers  have  failed  to  distinguish 
between  good  and  effective  schools  and  that,  "The  'effectiveness'  movement  is 
unnecessarily  restricting  the  cuiriculum,  narrowing  the  teaching  approach  to  direct 
instruction,  and  controlling  teachers"  (p.  624).  Cuban  (1984)  also  identified 
problems  with  the  effective  schools  research:  no  one  knows  how  to  create  effective 
schools,  the  language  is  fuzzy,  effectiveness  is  constricted  to  test  results,  and  most 
research  was  done  in  elementary  schools  (p.  129).  Fullan  (1985)  cautioned  that 
"nothing  would  be  worse  than  establishing  a  grand  scheme  putting  aU  schools  in  the 
district  through  the  paces  of  developing  effective  school  plans"  (p.  414). 
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It  is  evident  that  evaluations  of  programs  and  schools  must  look  well  beyond  the 
criteria  commonly  associated  with  the  effective  schools  movement  Evaluations 
must  be  broadly  based  and  multidimensional. 


Indicators  of  Effectiveness  or  Quality 

A  new  body  of  literature  is  beginning  to  evolve  and  offers  promise  as  a  means  of 
describing  effectiveness  and  quality  in  education.  The  development  of  "indicators" 
is  providing  a  new  focus  and  emphasis  in  educational  studies  and  in  schools. 
Common  ( 1987)  described  quality  in  education,  Mumane  and  Pauly  ( 1988) 
stressed  the  importance  of  developing  multiple  indicators,  and  Kaagan  and  Smith 
(1985)  pointed  out  that  indicators  provide  information  about  the  health  of  a  school 
system  but  cautioned  that  a  common  set  of  indicators  would  also  increase  the  move 
toward  centralization. 

The  Colorado  Department  of  Education  (1982)  presented  indicators  of  quality  in  12 
categories,  with  a  total  of  42  indicators.  This  list  bears  a  striking  similarity  to  the 
effective-schools  criteria  previously  discussed  in  the  review  of  literamre. 

In  both  Alberta  and  British  Columbia,  considerable  efforts  are  continuing  in  this 
area.  The  evaluation  model  presented  by  the  British  Columbia  Ministry  of 
Education  (1986)  consists  of  three  components:  goal  statements,  quality  indicators, 
and  an  interpretive  framework.  McEwen  and  Zatko  (1989),  on  behalf  of  Alberta 
Education,  provided  examples  of  indicators  of  students'  cognitive,  affective,  and 
behavioral  outcomes  as  well  as  indicators  describing  the  educational  context, 
inputs,  and  processes. 

The  Minist^re  de  lEducation,  Gouvemement  du  Quebec  (1989),  published  a  set  of 
indicators  as  one  means  of  responding  to  the  demand  of  accountability  in  public 
administration.  These  indicators  were  presented  in  five  categories: 

1 .  Financial  resources,  including  spending  in  relation  to  GNP,  school  board 
spending  per  student,  student-teacher  ratio,  and  average  teacher  salaries. 

2.  Progress  through  school,  measured  by  numbers  reaching  and  completing 
secondary  school,  failing  behind,  or  dropping  out  of  school. 

3 .  Evaluation  of  learning,  such  as  secondary  school  examination  results  by  sex. 
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school  system,  language  of  instruction,  type  of  education,  and  considering 
regional  disparities,  and  subjects. 

4.  Secondary  school  graduates  in  terms  of  numbers  and  types  of  diplomas, 
numbers  going  on  to  college,  and  numbers  joining  the  work  force. 

5 .  Adult  education  including  spending  by  board,  and  numbers  of  adult  graduates. 

The  American  Office  of  Educational  Research  and  Improvement  (1987)  identified 
the  following  outcomes  as  indicators:  reading  performance,  writing  performance, 
college-entrance  examination  scores,  high-school  completion  by  race  and  ethnicity, 
literacy  skills  of  your  adults,  and  participation  of  high  school  graduates  in 
postsecondary  education.  Resources  such  as  expenditures  per  pupil  were  listed  as 
well  as  the  "context"  indicators  (for  example,  home  environment). 

School  Improvement 

Since  the  goal  of  school  and  program  evaluation  is  the  improvement  of  schools,  it  is 
important  to  consider  the  literature  on  improvement.  Qose  similarities  exist 
between  the  findings  and  the  research  on  effective  schools. 

Leithwood  and  Fullan  (1984)  proposed  six  strategies  for  increasing  the  chance  of 
successful  change:  continuous  professional  development,  increasing  principal 
effectiveness,  school  planning,  developing  policies  with  a  view  to  their 
implementation,  using  standard  operating  procedures,  and  building  systematic 
problem  solving  procedures. 

Fullan  (1985)  went  even  further  and  presented  a  set  of  school-level  strategies.  This 
included  developing  a  plan,  investing  in  local  facilitators,  allocating  resources, 
selecting  schools,  and  deciding  on  the  scope  of  the  project,  developing  the 
principal's  leadership  role,  focusing  on  instruction,  stressing  ongoing  staff 
development,  ensuring  information  gathering  and  use,  planning  for  continuation 
and  spread  and  reviewing  the  capacity  for  further  change. 

Lezotte  and  Bancroft  (1985)  noted  that  successful  local  school  improvement 
programs  have  in  common  a  focus  on  a  single  school,  a  building-based 
improvement  team,  a  longer-term  orientation  (three  to  five  years)  in  planning  and 
implementation  and  are  organized  around  the  concept  of  the  effective  school. 
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Wcxxi,  Freeland,  and  Szabo  (1985)  noted  the  present  thrust  for  school 
improvement  differs  from  the  past  in  that  the  target  is  no  longer  the  district  or 
individual  staff  member,  but  the  school.  They  concluded  that  the  primary  method 
of  achieving  improvement  is  not  curriculum  development  but  staff  development; 
that  the  source  of  improvement  is  not  just  intuition  but  research  on  effective  schools 
and  effective  instructional  practices  and  that  planning  is  no  longer  year-to-year 
responding  only  to  immediate  needs,  concerns,  and  problems,  but  is  proactive, 
long  range,  and  systematic. 

Naisbitt  (1982)  appeared  to  lend  support  to  this  school-based  model  of 
improvement  with  his  statement  "Trends  are  bottom-up,  fads  top-down".  He 
advocated  moving  away  from  the  specialist  who  is  soon  obsolete  to  the  generalist 
who  can  adapt  to  a  "high-tech/high-touch"  world.  Although  he  was  mainly 
referring  to  business,  Naisbitt's  opinion  that,  "long-range  plans  must  replace  short- 
term  profit",  could  apply  equally  to  school  (p.  82).  He  declared  that  "strategic 
planning  is  worthless  unless  there  is  first  strategic  vision"  (p.  94).  Naisbitt's  view 
that  "Followers  create  leaders.  Period"  (p.  101)  summarizes  the  change  in  focus. 

According  to  the  Saskatchewan  Minister's  Advisory  Committee  (1985),  the  impetus 
can  come  from  outside  the  school  but  planning  and  action  must  occur  within. 
"School  improvement  is  taking  action  at  the  local  level"  (p.  7). 

External  versus  Internal  Evaluation 

Goodlad  (1984)  addressed  the  issue  of  external  versus  internal  evaluation  with  his 
statement,  "the  approach  having  the  most  promise  is  one  that  will  seek  to  cultivate 
the  capacity  of  schools  to  deal  with  their  own  problems,  then  become  largely  self- 
renewing"  (p.  31). 

The  school-based  approach  model  was  supported  by  Eisner  (1985),  Good  and 
Brophy  (1986),  and  Morgan  (1986)  who  concluded  that  the  most  successful 
systems  of  evaluation  are  likely  to  be  based  on  a  collaborative  approach  since  it 
assures  acceptability  which  may  be  more  crucial  than  validity  and  reliability. 

Shaw  (1988)  believed  that  after  a  thorough  self-study  is  undertaken  and 
accomplished,  visiting  team  members  could  serve  as  external  validators  for  the 
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work  of  the  local  staff  but  cautioned  that  school  evaluators  should  recognize  they 
cannot  learn  as  much  during  the  three-day  visit  as  local  staff  members  already  know 
about  their  school  program. 

Novak  (1985)  ascertained  that  too  much  stress,  time,  and  money  are  invested  in  the 
formal  preparation  and  visit  involved  in  extemal  evaluations,  even  though  agreeing 
that  schools  could  benefit  fi*om  some  periodic  outside  review. 

Other  researchers  advocating  the  value  of  internal  evaluators  include  Boud  and 
Donovan  (1982),  Herman  (1986),  and  Wilcox  (1989).  In  British  Columbia,  the 
Ministry  of  Education  developed  procedures  for  accreditation  which  serve  the 
school  and  program  evaluation  function  since  accreditation  is  defined  (1983)  as  "the 
outcomes  of  an  intemal  and  extemal  evaluation"  (p.  2).   Intemal  evaluation  is 
undertaken  by  the  staff  and  administration  within  the  school  and  is  designed  to 
encourage  and  assist  in  the  improvement  of  the  school  by  its  own  initiative  and 
effort  Extemal  evaluation  is  undertaken  by  an  extemal  committee  and  is  designed 
to  provide  an  evaluation  in  a  broader  frame  of  reference  to  confirm  or  question  the 
intemal  evaluation. 

After  a  thorough  review  of  the  literature,  and  based  on  his  previous  experience  and 
training,  Wamica  (1990)  concluded  that  "the  empowerment  of  school-based 
teachers  and  administrators,  and  the  schools  as  the  focus  of  action  and  development 
offer  the  greatest  potential  for  real  growth  and  development  of  the  school,  its  staff 
and  its  programs  for  students"  (p.  15). 

Application  to  the  Art/Library  Program  Evaluation  Models 

The  research  and  the  findings  of  Wamica's  study  provided  the  basis  for  the 
development  of  the  art  and  library  program  evaluations.  In  addition,  the  developers 
reviewed  the  literature  pertaining  specifically  to  the  development  of  quality 
indicators,  outcomes-based  education  and  references  to  results-based  approaches  as 
identified  by  Kaufman  (1988).  Primary  references  for  the  art  program  evaluation 
were  the  Alberta  Art  Program  of  Studies  for  elementary  (1985),  junior  high  (1984), 
and  senior  high  (1986)  schools.  Attention  in  these  documents  focused  on  the 
philosophical  base  and  on  the  knowledge,  skills,  and  attitudes  outlined.  The  Focus 
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on  Learning:  Integrated  Program  Model  for  Alberta  School  Libraries  (Alberta 
Education,  1985)  was  used  in  the  development  of  the  Library  Program  Evaluation 
model. 
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Chapter  3 
Design 

Evaluation  of  the  Former  Model 

Wamica's  case  study  looked  at  the  former  Lethbridge  School  District  No.  51  school 
and  program  evaluation  models.  The  results  of  his  research  were  applied  to  the  art 
and  library  programs.  These  programs  field-tested  a  model  based  on  the  results  of 
his  study.  Subsequentiy,  a  generic  collaborative  model  was  developed  to  overcome 
the  perceived  deficiencies  of  the  former  "top-down"  approach. 

For  the  type  of  naturalistic  research  being  done  in  both  the  initial  study  and  the 
subsequent  application  to  the  two  programs,  a  qualitative  case-study  design, 
supplemented  by  some  limited  statistical  analysis,  was  the  preferred  mode. 
Patton's  (1980)  observation  that  "researchers  using  qualitative  methods  attempt  to 
understand  programs  as  a  whole"  would  support  this  approach  (p.  40). 

The  Lethbridge  study  made  use  of  large  quantities  of  data  that  had  been  collected 
over  a  three  year  period  of  school  and  program  evaluations,  using  instruments 
designed  by  Lethbridge  School  District  No.  51  but  similar  to  those  used  in  other 
districts  in  Alberta  and  by  Goodlad  (1984).  The  initial  Lethbridge  results  as 
outiined  in  Wamica's  case  study  were  compared  to  the  findings  of  Goodlad. 

The  Lethbridge  model  spears  to  meet  Goodlad's  (1984)  assertion  that  efforts  at 
"school  improvement  must  encompass  the  school  as  a  system  of  interacting  parts 
each  affecting  the  other"  (p.  31).  The  broadly  based  emphasis  of  the  model  with 
focus  on  all  aspects  of  the  school  ranging  from  instructional  programs  to  non- 
instructional  programs  acknowledges  that  each  part  of  the  school's  operation  affects 
all  other  aspects  (Wamica,  1989,  p.  105). 

In  Wamica's  case  study,  a  Pearson  r  coefficient  of  correlation  was  computed  on  the 
ratings  of  the  researcher  and  the  "panel  of  experts".  This  panel  was  composed  of 
four  school  principals  who  were  chosen  because  they  were  familiar  with  all  aspects 
of  the  evaluation  process  and  had  participated  in  it.  The  correlation  was  computed 
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to  be  0.6  which  can  be  interpreted  to  be  a  "high"  relationship  according  to 
Morehouse  and  StuU  (1975,  p.  198). 

Wamica  and  the  panel  checked  for  inter-subject  validity  verification  in  order  to 
control  the  possibility  of  researcher  bias.  The  data  collected  from  students, 
teachers,  and  parents  was  analyzed  to  check  for  degree  of  association  using  Pearson 
Product-Moment  Correlation  Coefficients  and  also  compared  with  data  from  the 
Goodlad  (1984).  An  analysis  showed  the  areas  of  greater  agreement  between  the 
researcher  and  the  panel  of  experts  who  gave  highly  positive  ratings  to  statement 
covering  several  aspects  of  the  process.  These  included  communication  with  the 
evaluation  team,  opportunity  for  parental  input,  recommendations  which  were 
reasonable  and  accurate,  an  evaluation  report  which  was  presented  in  draft  form  to 
the  school  prior  to  its  finalization  and  release,  and  the  fact  that  the  school  developed 
a  plan  to  respond  to  recommendations.  Similar  agreement  existed  in  terms  of  the 
present  model  being  predominantly  "top  down",  and  the  need  for  greater 
involvement  of  teachers  and  school-based  administrators.  Both  the  researcher  and 
the  panel  gave  low  ratings  to  the  attention  paid  to  school  social  inputs  and  to  the 
clarity  of  the  evaluator's  role  after  the  report  was  written. 

The  researcher  was  much  less  positive  than  was  the  panel  that  the  input  of  school 
administrators  and  teachers  in  the  original  model  was  adequate.  Close  agreement 
existed  between  the  researcher  and  the  panel  in  a  number  of  other  areas.  The 
usefulness  of  the  evaluation  report  was  rated  fairly  highly  by  each. 

The  approach  to  school  and  program  evaluation  as  used  in  the  Lethbridge  models 
encompasses  virtually  every  one  of  the  indicators  of  effectiveness  presented  by 
Squires  et  al  (1983)  in  their  questionnaire  for  assessing  school  and  classroom 
effectiveness.  The  Lethbridge  model  appears  to  meet  Goodlad's  (1984)  assertion 
that  efforts  at  "school  improvement  must  encompass  the  school  as  a  system  of 
interacting  parts  each  affecting  the  other"  (p.  31).  The  broadly  based  emphasis  of 
the  model  with  a  focus  on  all  aspects  of  the  school  ranging  from  instructional 
programs  to  non-instructional  programs  acknowledges  that  each  part  of  the  school's 
operation  affects  all  other  aspects. 
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The  Lethbridge  model  developed  by  Wamica  adequately  addresses  many  of  the 
checkpoints  of  the  Key  Evaluation  Checklist  developed  by  Scriven  (1976)  in  terms 
of  description,  clients,  function,  consumer,  process,  outcomes,  generalizability, 
significance,  and  reporting.  In  the  view  of  the  researcher  and  confirmed  by  the 
panel  of  experts,  there  are  some  problems  with  the  delivery  system,  the  standards 
by  which  programs  are  evaluated  (the  lack  of  a  clear  set  of  indicators  of  educational 
quality),  the  usefulness  of  the  outcomes  (since  there  are  problems  in  implementing 
recommendations),  the  costs,  and  the  thoroughness  of  the  meta-evaluation. 

The  lack  of  absolute  standards  by  which  programs  can  be  compared  and  assessed  is 
a  weakness  of  the  Lethbridge  model.  Another  area  where  the  Lethbridge  model  is 
weak,  according  to  the  "E  Standards"  as  produced  by  North  Central  Association 
Commission  on  Schools  (1987-88),  is  in  teacher  involvement  in  assessing  the 
effectiveness  of  the  program  and  planning  for  its  improvement.  The  school 
evaluation  procedures  in  Lethbridge  placed  teachers  who  provided  litde  meaningful 
involvement  in  determining  the  nature  of  desirable  changes,  as  recipients  of  the 
process.  Teacher  involvement  came  only  after  the  extemal  evaluators  had 
determined  what  changes  should  be  made.  The  collaborative  evaluation  model 
includes  procedures  to  check  that  the  characteristics  common  to  effective  schools 
are  in  place. 

The  lack  of  clearly  established  and  accepted  indicators  of  educational  effectiveness 
or  quality  in  the  Lethbridge  approach  to  school  evaluation  was  one  of  the  major 
weaknesses  identified  by  Wamica.  Although  many  of  the  qualitative  and 
quantitative  indicators  may  be  inferred  in  the  Lethbridge  models,  they  were  not 
specifically  identified  and  looked  for  as  part  of  the  evaluation.  Little  emphasis  was 
placed  on  interpretive  indicators  of  context,  input,  and  process,  or  on  outcome 
indicators  of  the  cognitive,  affective,  or  behavioral  nature.  A  set  of  standards  or 
basis  for  comparison  was  absent.  The  result  was  that  judgements  were  made  about 
program  quality  and  effectiveness  without  the  strength  of  a  set  of  agreed-upon 
standards. 

The  literature  on  school  improvement  leads  to  some  criticism  of  the  school 
evaluation  model  in  question.  The  concems  of  Leithwood  and  Fullan  (1984)  have 
not  been  addressed  adequately.  They  believed  that  successful  change  involves 
pressure  gradually  acquired  through  interaction  with  peers  and  other  leaders,  not 
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mandated  by  authority.  The  Lethbridge  evaluation  model  placed  emphasis  for 
change  from  the  pressure  brought  about  by  the  evaluation  report  instead  of  from 
interaction  with  peers.  The  Lethbridge  School  District  No.  51  approach  did  not 
utilize  the  suggestions  of  Landon  and  Shirer  (1986)  in  the  Wisconsin  School 
Evaluation  Plan  to  have  the  school  conduct  a  self-evaluation  which  is  then  audited 
by  an  outside  team.  Similarily,  the  collaborative  planning  as  espoused  by 
Patterson,  Purkey,  and  Parker  (1986)  was  not  evident. 

Wood,  Freeland,  and  Szabo  (1985)  recommended  a  focus  on  staff  development 
instead  of  the  traditional  emphasis  on  curriculum  development,  and  for  planning 
that  is  proactive,  long  range,  and  systematic.  The  Lethbridge  evaluation  model  was 
not  consistent  with  the  suggestions  of  these  and  several  other  researchers  in  the  area 
of  school  improvement. 

The  findings  from  this  research  led  to  the  development  of  the  collaborative  model. 

Change  of  Focus 

Although  the  intent  of  the  original  research  was  to  focus  on  school  evaluation, 
system  senior  administration  and  the  board  of  trustees  directed  the  move  toward 
program  evaluatioa  Using  the  smdy  by  Wamica  as  a  basis  of  information,  work 
then  proceeded  on  the  application  of  this  research  to  the  development  of  a 
collaborative  model  for  art  and  library  program  evaluations.  These  programs  were 
selected  for  a  number  of  reasons:  the  system  perceived  need  to  evaluate  the 
effectiveness  of  these  programs;  availability  of  central  office  leadership;  and  in 
regard  to  the  art  program,  a  perceived  lack  of  teacher  expertise  in  art  evaluation  due 
in  part  to  the  difficulty  encountered  in  obtaining  subject-specific  information  in  this 
area.  Acting  upon  recommendations  from  the  administration,  the  board  of  trustees 
approved  the  development  and  implementation  of  a  new  evaluation  format 

Steering  committees  were  organized  for  each  of  these  program  areas.  Meetings 
were  held  in  which  the  committees  were  given  instruction  and  direction  on  the 
development  of  quality  indicators  which  guided  the  work  of  both  committees.  As  a 
result  of  staffing  changes,  identified  system  needs,  and  the  availability  of  time,  the 
art  program  became  the  focus  for  the  final  stages  of  the  project  Work  continued 
through  the  various  steps  outlined  in  the  Art  Program  Evaluation  Flow  Chart 
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(Figure  1).  Questionnaires  were  developed  for  die  following  stakeholder  groups: 
Teacher/Administration;  Parents  Grades  1-6;  Students  Grades  1-3;  Students  Grades 
4-6;  Secondary  Parents;  Students  Grades  7-12.  (See  Appendix  B).  Prior  to  the 
distribution  of  these  forms  to  the  schools,  they  were  reviewed/validated  by  other 
teachers,  system  administrators  and  the  Parent  and  Student  Advisory  Council. 
(Following  direction  from  the  Parent  and  Student  Advisory  Council,  questionnaires 
for  non-art  students  at  the  secondary  level  and  their  parents  were  developed.  The 
response  to  these  questionnaires  was  very  poor  making  it  impossible  to  provide  any 
valid  data.)  The  committee  continued  work  on  the  identification  and  verification  of 
the  student  outcomes  as  well  as  the  re-examination  and  modification  of  instruments 
used  to  identify  system  and  teacher  inputs.  Assessment  tools  and  processes  were 
identified,  developed,  and/or  refined.  A  follow-up  questionnaire  was  developed 
and  distributed  to  stakeholder  groups  to  ascertain  whether  the  new  program 
evaluation  model  was  perceived  as  an  improvement  over  the  previous  model.  If  so, 
why  was  it  regarded  as  an  improvement  and,  would  the  resulting  action  plans  have 
a  positive  impact  on  the  program? 

Modifications  were  made  to  the  art  evaluation  flow  chart  with  the  addition  of  the 
follow-up  questionnaire  and  the  reversal  of  the  final  steps  as  the  system  action  plan 
was  implemented  prior  to  the  completion  of  the  EQI  report 

Work  is  continuing  on  the  project  in  an  effort  to  verify  that  the  processes  are  both 
adequate  and  accurate.  The  focus  of  this  work  is  to:  (1)  ensure  that  there  is 
congruence  between  desired  and  actual  student  outcomes,  and  (2)  verify  that  the 
use  of  the  new  model  ensures  ongoing  improvement  in  program  evaluations  and  in 
the  achievement  of  desired  student  outcomes. 
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Chapter  4 


Development  of  the  Model 

Warnica  ( 1989)  discussed  the  effectiveness  of  system/program  evaluation, 
conducted  a  review  of  current  related  literature,  and,  as  a  result  of  his  case  study, 
defined  the  criteria  for  a  more  effective  model  of  school  and  program  evaluation 
with  emphasis  on  the  development  of  education  quality  indicators.  The  findings  of 
his  smdy  were  then  applied  to  evaluating  two  school  system  programs:  the  art  and 
the  library. 

1991  Art  and  Library  Evaluations 

Purposes 

1 .  To  apply  Wamica's  model  to  specific  programs. 

2 .  To  identify  quality  indicators  for  the  programs. 

3 .  To  identify  and/or  develop  assessment  procedures  for  the  verification  of  the 
indicators. 

4.  To  gather  information  as  to  the  stakeholders'  (school  staff,  administration, 
students,  parents)  perception  of  the  effectiveness  of  these  programs  in  each 
school  and  in  the  district  as  a  whole. 

5.  To  provide  assistance  for  teachers,  particularly  at  the  elementary  level,  by 
identifying  the  quality  indicators  for  art  and  by  providing  suggestions/examples 
of  assessment  procedures. 

6.  To  develop  an  action  plan  for  improving  the  art  and  library  programs  in  the 
schools  and  the  district. 

Procedures 

A  steering  conmiittee  was  organized  and  a  number  of  meetings  held  during  which 
instruction/direction  on  the  meaning  of  and  the  identification  of  quality  indicators 
was  given.  This  committee  of  internal  and  external  evaluators  was  composed  of 
teachers,  administrators,  and  an  Alberta  Education  consultant;  it  included  generalist 
and  specialist  teachers  from  elementary  and  secondary  schools.  The  committee 
identified  and  developed: 
a)  quality  indicators  for  the  art  programs 
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b)  questionnaires  for  the  following  target  audiences: 

•  teacher/administrators 

•  parents  1-6 

•  students  grades  1-3 

•  students  grades  4-6 

•  parents  7-12 

•  students  7-12 

and  acting  upon  a  recommendation  from  the  Parent/Student  Advisory  Council,  a 
questionnaire  for  non-art  students  and  their  parents  at  the  secondary  level. 
(Appendix  B). 

c)  the  implementation  format  for  the  evaluation  process  within  the  parameters 
previously  identified. 

Before  distributing  the  questionnaires,  the  evaluation  package  was  presented  to 
school  district  administrators  for  validation  and  staff  information.  Data  fi-om  the 
questionnaires  were  compiled  and  summaries  prepared  prior  to  the  school 
visitations  by  the  extemal  evaluation  team. 

Following  the  school  visits  a  team  perception  check  was  held.  The  steering 
committee  used  the  information  from  the  questionnaires  and  the  findings  of  the 
evaluation  team  to  formalize  the  report.  This  report,  which  included  both  individual 
school  and  system  information,  was  presented  to  the  board  of  trustees. 
Subsequentiy  action  plans  were  developed  in  response  to  the  report  at  both  the 
system  and  individual  school  level.  Work  continued  on  the  refinement  of  the  art 
program  evaluation  model.  This  included  the  identification  of  quality  indicators  of 
desired  student  outcomes  as  well  as  the  procedures  to  use  indicators  in  evaluating 
the  effectiveness  of  programs.  Assessment  procedures  to  measure  student 
outcomes  were  identified  and/or  developed. 

The  key  component  in  the  development  of  educational  quality  indicators,  as 
identifiedA^erified  by  the  steering  committee  and  the  stakeholder  groups,  is  the 
collaboration  between  school-based  and  district-based  staff  working  together  to 
determine  comparatorsAndicators  (which  focus  on  student  outcomes  in  the 
cognitive,  affective,  and  behavioral  domains).  These  must  all  be  developed  within 
an  interpretive  fi^mework  which  places  emphasis  on  context,  inputs,  and  process. 
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Discussion 

The  art  survey  included  specific  areas  common  to  all  the  questionnaires 
(Appendix  B)  about  which  information  was  being  garnered.  Some  of  the  major 
types  of  questions  related  to  the  importance  of  art  as  a  program,  facilities, 
budget/equipment/supplies,  art  instruction,  activities.  The  following  table 
highlights  some  common  questions  for  the  different  respondent  groups. 

Table  2 

Common  Questions  for  Respondent  Groups  in  the 
1991  Art  Evaluation 

Question        Teachers/  Students  Parents 

Administrators   

1-3  4-6  7-12 


importance 

1 

2,3 

2,3 

2,5 

2,  5,  11 

facilities 

2 

2 

3 

1 

resources 

3 

3 

2,8 

2,3 

7 

instruction 

4 

4 

4,11,  15 

4,  10,  11, 
12,  14, 15 

1,  3 

activities 

5 

1,7,8 

1,7,9,11 

7 

8 

enjoyment 

9 

9,  12 

8 

8,9 

6,9 

group  effort 

12 

12 

10 

perceived  ability 

10 

10,  14 

10, 14 

16 

4,  12,  13,  14 

As  very  good  art  facilities  are  provided  in  the  secondary  schools  in  Lethbridge 
School  District  No.  51,  no  questions  in  this  regard  were  included  on  either  the 
student  or  parent  survey. 

Findings 

The  steering  committee  perceived  that  administrators,  teachers,  students,  and 
parents  consider  art  as  an  important  component  of  the  school  program.  The  results 
of  the  questionnaires  confirmed  this  perception. 
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Even  though  art  is  considered  important,  there  is  no  system  statement  that  would 
provide  ongoing  support,  focus,  and  direction  for  the  art  program.  Such  a 
statement  could  have  reference  to  the  contribution  the  study  of  art  makes  to  the  total 
education  of  the  child,  i.e,  its  emphasis  on:  critical  thinking  and  problem-solving 
skills;  communication  skills;  and  promoting  a  better  understanding  of  and 
appreciation  for  art  and  artists  across  cultures  and  across  time. 

The  following  topics  were  examined  under  the  broad  heading  of  planning  and 
organization: 

•  sense  of  direction,  focus,  purpose 

•  objectives,  concepts/skills,  sequencing 

•  instructional  techniques,  activities 

•  resources 

•  evaluation 

•  integration  and  co-operative  planning 

•  budget  and  facilities 

The  survey  results  found  evidence  of  in-depth  planning  but  it  was  not  consistent 
either  within  all  schools  or  across  the  system.  Only  28%  of  teachers  using  a  self- 
rating  indicated  a  very  high  adherence  to  the  Program  of  Studies  and  confidence  in 
their  long-range  and  unit  planning. 

Generally,  the  respondents  were  satisfied  with  the  categories  of  budget,  equipment, 
and  supplies.  Storage  space  and  student  work  areas  were  identified  by  35%  of  the 
elementary  teachers/administrators  as  in  need  of  improvement. 

As  predicted  by  the  steering  committee,  evaluation  procedures  were  identified  as  an 
area  of  concern.  Thirty-three  percent  of  the  students  did  not  know  how  their  report 
card  mark  was  established.  Only  7%  of  the  students  indicated  a  clear 
understanding;  80%  of  the  parents  were  not  aware  of  how  their  child  was  being 
evaluated  in  art  and  37%  of  teachers  indicated  problems  with  evaluation  procedures. 
Forty-eight  percent  of  the  teachers  indicated  that  they  felt  their  training  was 
inadequate  for  the  presentation  of  a  balanced  art  program. 

These  findings  partially  substantiated  the  original  premise  regarding  teacher 
expertise,  particularly  in  regard  to  evaluation  procedures. 
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A  follow-up  questionnaire  and  the  preparation  of  program  action  plans  confirmed 
that  the  collaborative  model  was  preferred  and  that  the  identification  of  quality 
indicators  were  considered  essential  components  of  the  evaluation  process. 

Information  on  the  questionnaires  and  the  results  of  the  library  evaluation  can  be 
found  in  Appendix  D. 

Unfortunately,  the  original  data  that  had  been  collected  were  erased,  making  further 
analyses  difficult.  However,  a  summary  of  the  data  collected  from  the  various 
target  audiences  can  be  reviewed  in  the  Art  Program  Evaluation  and  the  Library 
Program  Evaluation  (see  Appendices  C  and  D). 
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Chapter  5 


A  Collaborative  Model  for  School  and  Program 

Evaluation 

The  case  study  (Wamica,  1989)  found  that  the  Lethbridge  model  for  system 
evaluation  satisfied  many  of  the  criteria  of  effectiveness,  quality  and  improvement 
in  terms  of  receiving  input  from  all  stakeholders,  utilizing  an  evaluation  team  with 
expertise  and  credibility,  and  using  a  multidimensional  focus  to  examine  a  broad 
range  of  both  instructional  and  non-instructional  aspects  of  the  school.  However, 
the  model  was  judged  by  the  researcher  to  have  limitations  in  that  it  was  "top- 
down"  with  litde  opportunity  for  meaningful  participation  and  professional  growth 
by  the  school  staff  and  administration.  There  are  strong  doubts  as  to  whether  the 
information  gained  from  the  model  is  of  sufficient  value  related  to  professional 
growth  and  improvement  to  warrant  the  heavy  costs  of  human  resource  time  and 
energy.  A  major  weakness  of  the  model  is  the  lack  of  clearly  established  and 
accepted  sets  of  standards  or  indicators  of  quality.  Concerns  with  the  ability  of 
schools  to  implement  the  recommendations  leads  to  serious  questions  about 
whether  significant  improvements  come  about. 

Wamica's  case  study  determined  that  the  procedures  and  instruments  in  place  had 
strong  face,  content,  and  constmct  validity.  No  attempt  was  made  to  demonstrate 
external  validity  since  the  purpose  was  not  to  generalize  the  conclusions  reached  at 
one  school  to  another  one.  Some  doubts  about  reliability  and  validity  were  raised 
since  the  items  were  not  field-tested  and  some  items  were  changed  from  school  to 
school  with  loss  of  comparability  of  certain  results.  Although  reliability  (intemal 
consistency  or  stability)  was  never  calculated,  the  instruments  appear  to  be 
consistent  as  indicated  by  the  high  correlations  which  were  found. 

The  literature  was  clear  that  there  are  certain  criteria  and  characteristics  which  could 
be  incorporated  into  the  Lethbridge  school  evaluation  procedures  to  increase 
effectiveness  and  efficiency: 

1 .  The  new  model  should  move  away  from  the  heavy  emphasis  on  a  "top-down" 
approach  to  encourage  and  empower  school  staff  and  administrators  to  be 
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actively  involved  and  interacting  in  assessing  the  effectiveness  of  their  own 
programs  and  planning  for  their  improvement  A  model  involving  a  better 
balance  between  internal  and  extemal  evaluation  should  be  considered. 

2 .  The  development  of  a  clear  set  of  standards  or  indicators  of  educational  quality 
would  be  a  desirable  step  in  moving  the  evaluation  model  onto  more  objective 
ground,  and  would  allow  change,  and  the  flexibility  to  adapt  it  to  individual 
circumstances;  change  does  not  come  from  externally  imposed  procedures 
(Fullan,  1982).  School  evaluation  should  be  a  continuous  process.  Schools 
need  to  identify  areas  requiring  improvement  to  work  actively  toward  this  end. 
Empowerment  of  school-based  staff  and  administration  is  fundamental  to 
reviewing  and  improving  schools. 

Application  to  Lethbridge  School  District  No.  51 

School  and  Program  Evaluations 

A  more  effective  model  of  program  evaluation  through  the  use  of  quality  indicators 
was  developed  for  the  art  and  library  programs.  Because  of  die  collaborative  nature 
of  this  approach,  there  was  a  "buy  in"  by  the  stakeholder  groups.  The  result  has 
been  that  each  school  is  beginning  to  evaluate  its  own  educational  quality  and 
effectiveness  in  a  professional  manner  which  serves  to  empower  school-based  staff 
and  contributes  to  meaningful  and  effective  school  growth  and  improvement 

Art  programs  are  frequentiy  perceived  as  being  more  difficult  to  evaluate,  both  as  a 
result  of  littie  available  research  in  this  area  as  well  as  the  fact  that  generalist 
teachers  have  littie  or  no  training/expertise  in  the  area  of  art  evaluation.  There  has 
been  a  perception  that  evaluation  of  a  child's  art  inhibits  creativity.  A  follow-up 
questionnaire  to  the  evaluation  confirmed  tiiat  the  application  of  the  collaborative 
model  and  the  subsequent  identification  of  quality  indicators  resulted  in  a  positive 
attitude  change  in  teachers. 

Figure  2  identifies  inputs  and  processes.  The  desired  student  outcomes  as  well  as 
suggested  assessment  procedures  are  outlined.  This  is  basically  a  generic  model 
that  could  be  readily  adapted  to  any  subject  area  with  few  modifications. 

Figure  3  indicates  a  further  development/refinement  of  the  model. 
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Based  on  current  literature  and  the  practical  application  of  the  proposed  model 
during  the  Lethbridge  School  District  No.  51  evaluations,  stakeholder  groups  have 
confirmed  that  a  more  effective  collaborative  model,  involving  the  development  of 
educational  quality  indicators  has  been  designed,  implemented.  (Further 
refinements  will  be  ongoing).  The  development  of  a  clear  set  of  standards  or 
indicators  of  educational  quality  is  a  desirable  step  in  moving  the  evaluation  model 
onto  more  objective  grounds.  This  process  will  allow  much  more  professional 
involvement  of  school-based  personnel.  Although  the  art  program  evaluation  was  a 
practical  application  of  the  research,  the  model  that  has  been  developed  could  be 
applied,  with  few  modifications,  to  other  subject  areas.  Community/stakeholder 
groups'  involvement  in  the  evaluation  process  has  proven  to  be  very  valuable  and 
should  be  continued/established  in  school  jurisdictions.  The  "buy  in"  that  this 
provides  is  essential. 
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Chapter  6 


Summary  and  Discussion 

In  recent  years  there  has  been  a  marked  increase  in  the  emphasis  and  expectations 
for  program  and  school  evaluations.  Throughout  much  of  Alberta,  the  approach 
used  has  been  predominantly  a  "top  down"  process  with  the  planning  and 
procedures  carried  out  almost  exclusively  by  personnel  from  Alberta  Education  or 
district  central  offices  with  assistance  by  external  resource  persons.  A  meta- 
evaluation,  conducted  by  Lethbridge  School  District  No.  51,  concluded  that  limited 
changes  were  being  realized  by  the  evaluations  since  the  teachers  and  school-based 
administrators  were  not  actively  involved  (except  for  having  the  process  "done  to" 
them)  and  hence  gained  little  from  the  exercise.  A  study  of  the  related  literature  and 
procedures  used  in  other  locations  led  to  the  proposal  for  a  "collaborative  model" 
which  would  empower  school-based  personnel  to  be  actively  and  professionally 
involved  in  their  school  and  program  evaluations.  The  use  of  "educational  quality 
indicators"  would  serve  as  a  key  component  of  the  model. 

Rationale 

The  evaluation  of  teaching  and  of  teachers  has  received  in-depth  smdy  but  little 
effort  seems  to  have  been  put  into  whether  the  models  and  procedures  used  for  the 
relatively  new  focus  on  school  and  program  evaluations  are  consistent  with  the 
findings  of  educational  research.  Because  the  stated  goal  of  evaluation  is  almost 
always  school  improvement,  there  is  a  need  to  consider  and  utilize  the  research  on 
quality  indicators,  school  effectiveness,  and  school  improvement.  A  collaborative 
model  would  ensure  a  "buy  in"  by  those  involved.  This  is  essential  as  evaluation 
alone  does  not  cause  improvement. 

In  the  province  of  Alberta,  as  in  other  Canadian  provinces  and  a  number  of 
American  states,  there  has  been  an  increasing  emphasis  and  expectation  from 
governments  that  school  jurisdictions  will  develop  and  carry  out  formalized 
procedures  for  evaluation,  including  the  evaluation  of  students,  teachers,  programs, 
schools,  and  school  systems. 
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The  Lethbridge  model  involved  the  use  of  a  large  team  (up  to  55  persons)  from  the 
school  district  central  office,  other  schools.  Alberta  Education  offices,  and  the 
University  of  Lethbridge,  spending  up  to  three  weeks  of  time  on  site  for  the  school 
evaluation  process.  A  common  concern  was  whether  the  model  (which  was 
extremely  expensive  in  terms  of  professional  time  and  expertise)  was  producing 
payoff  in  professional  growth  and  development.  Perhaps  the  most  significant 
concern  was  with  the  problem  of  implementing  the  recommendations  emanating 
from  the  evaluation  report 

Administrators  and  boards  need  assurance  that  their  models  of  school  and  program 
evaluation  are  consistent  with  increased  effectiveness  and  school  improvement  as  a 
result  of  the  investments  of  professional  time,  expertise,  and  budget  dollars. 
Stufflebeam  and  Shinkfield  (1985)  affirmed  that  if  evaluations  are  to  be  useful  and 
provide  proper  direction  and  guidance,  "the  evaluations  themselves  must  be  sound" 
(p.  183). 

Purpose 

The  purpose  of  the  Lethbridge  School  District  No.  51  project  was  to  develop  a 
more  effective  model  for  school  and  program  evaluation.  Consequently,  the 
following  research  questions  were  addressed: 

1 .  Is  the  current  Lethbridge  School  District  No.51  model  for  program  and  school 
evaluation  consistent  with  the  literature  on  indicators  of  effectiveness,  quality, 
and  school  improvement? 

2.  Are  the  procedures,  instruments,  and  data  used  in  the  Lethbridge  School  District 
No.51  model  valid  and  reliable? 

3 .  Does  the  current  literature  suggest  characteristics  or  criteria  of  more  effective 
and  efficient  models  for  program  and  school  evaluation,  in  terms  of  indicators 
of  effectiveness,  quality,  and  improvement? 

4.  If  the  findings  for  the  above  indicate  "yes",  can  the  findings  be  applied  to 
the  development  of  a  collaborative  model  for  a  school  system  program 
evaluation  for  the  art  and/or  the  school  library  program? 
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Design 

Wamica  (1989)  completed  a  case  study  of  the  Lethbridge  model  for  school  and 
program  evaluation.  It  was  primarily  qualitative  in  nature,  but  included  some 
correlations.  The  major  areas  of  educational  literature  reviewed  as  a  basis  for  this 
study  and  the  proposed  model  were:  school  and  program  evaluation  -  theory  and 
practice;  effective  schools  research;  indicators  of  effectiveness  or  quality;  and, 
evaluation  models,  criteria,  and  standards. 

After  his  review  of  the  literature  and  based  on  career  experience,  Wamica  (1990) 
concluded  that  the  decision  on  the  debate  related  to  the  external  versus  internal 
evaluation  model  falls  clearly  on  the  side  of  the  school-based  model.  The 
convincing  arguments  of  Boud  and  Donovan  (1982),  Common  (1987),  Herman 
(1986),  Toffler,  (1980),  and  Eisner  (1985)  provide  sound  reasons  for  a  model 
which  involves  more  active  and  professional  participation  of  school-based 
personnel.  The  empowerment  of  school-based  teachers  and  administrators,  and  the 
school  as  the  focus  of  action  and  development  offer  the  greatest  potential  for  real 
growth  and  development  of  the  school,  its  staff,  and  its  programs  for  students. 

Although  the  intent  of  the  original  research  was  to  focus  on  school  evaluation, 
senior  administrators  and  trustees  directed  the  move  toward  program  evaluation. 
Using  the  study  as  a  basis  of  information,  work  then  proceeded  on  the  application 
of  this  research  to  the  development  of  a  collaborative  model  for  art  and  library 
program  evaluations.  These  programs  were  selected  for  a  number  of  reasons: 

•  a  system  perceived  need  to  evaluate  the  effectiveness  of  these  programs; 

•  availability  of  central  office  leadership;  and 

•  concerns  about  the  lack  of  expertise  of  the  generalist  teacher  in  the  area  of  art 
evaluation  and  the  lack  of  available  research  on  this  topic. 

Acting  upon  recommendations  from  the  administration,  the  Board  approved  the 
development  and  implementation  of  a  new  evaluation  format  Steering  committees, 
consisting  of  generalist  and  specialist  teachers  representing  elementary  and 
secondary  schools,  administration  and  Alberta  Education  personnel,  were  organized 
for  each  program  area.  Meetings  were  held  during  which  time  these  committees 
were  given  instruction  and  direction  on  the  development  of  quality  indicators.  Both 
committees  proceeded  through  the  steps  outlined  in  the  art  program  flow  chart. 
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During  the  second  year  of  the  project,  a  model  was  developed  and  field-tested  for 
evaluating  the  two  identified  programs.  The  collaborative  model  provided  the 
structure  for  application  of  the  effective  schools  research  about  evaluation  and  the 
use  of  indicators  of  effectiveness  or  program  quality.  Key  components  in  the 
development  of  the  educational  quality  indicators  included  the  district-based  staff, 
and  the  community  and,  the  resulting  determination  of  comparators,  standards,  and 
quality  outcomes  for  all  programs. 

Following  the  collection  of  data  through  interviews  and  the  administration  of 
questionnaires  to  the  various  stakeholder  groups,  analyses  was  conducted.  As  a 
result  of  the  findings,  a  system-  and  school-based  action  plan  was  developed  and 
initiated. 

As  a  result  of  staffing  changes,  identified  system  needs  and  the  availability  of  time, 
the  art  program  became  the  focus  of  the  project  in  the  third  year.  Work  continued 
through  the  various  steps  outlined:  the  identification  and  verification  of  the  student 
outcomes;  and,  the  identification,  development,  and  refinement  of  evaluation  tools 
and  processes.  System  and  teacher  inputs  were  re-examined  and  the  instruments 
modified  as  required. 

Findings 

The  findings  of  the  case  study  indicated  that  a  new  model  for  school  and  program 
evaluation  should  be  developed.  The  result  of  the  research  was  the  development  of 
a  collaborative  model  which  places  much  greater  responsibility  and  control  in  the 
hands  of  the  stakeholders  -  school-based  administrators,  staff,  students,  and 
parents.  They  become  major  participants  and  decision  makers  in  school  and 
program  evaluations,  in  identifying  areas  of  program  and  professional  growth,  and 
in  bringing  about  change.  The  model  rests  upon  certain  basic  assumptions 
grounded  in  the  literature  on  school  effectiveness  and  school  improvement  The 
school  is  the  primary  unit  of  decision  making  (Smith  and  Purkey,  1985).  If 
changes  are  to  occur,  they  require  ownership  that  comes  from  the  opportunity  to 
participate  in  defining  change,  and  the  flexibility  to  adapt  it  to  individual 
circumstances.  Change  does  not  come  from  externally  imposed  procedures 
(Fullan,  1982). 
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Schools  need  to  identify  areas  requiring  improvement  and  work  actively  toward  this 
end.  Empowerment  of  school-based  staff  and  administration  is  fundamental  to 
reviewing  and  improving  schools.  As  a  perception  check,  a  follow-up 
questionnaire  was  distributed  to  the  stakeholders  at  the  conclusion  of  the  art 
evaluation.  The  results  from  this  questionnaire,  in  conjunction  with  a  review  of  the 
content  and  the  initiation  of  the  program  action  plans  developed  by  the  schools, 
confirmed  that  the  collaborative  model  was  preferred  (Appendix  C). 

The  collaborative  nature  of  this  approach  resulted  in  a  "buy  in"  by  stakeholder 
groups.  The  development  and  use  of  quality  indicators  was  positively  received  and 
their  use  incorporated  into  all  assessment  procedures. 

As  predicted  by  the  art  steering  committee,  evaluation  procedures  were  identified  as 
an  area  of  concern.  A  third  of  the  over  3,000  students  surveyed  did  not  understand 
how  their  report  card  mark  was  established;  only  7%  indicating  a  clear 
understanding  of  the  process.  Most  parents  (80%)  were  not  aware  of  how  their 
child  was  being  evaluated  and  37%  of  the  teachers  questioned  indicated  problems 
with  evaluation  procedures.  A  follow-up  questionnaire  addressed  to  teachers  and 
administrators  confirmed  that  through  the  application  of  the  collaborative  model  and 
the  identification  of  quality  indicators,  a  positive  change  in  attitude  regarding 
assessment  in  art  had  taken  place. 

The  model  presented  in  Figure  2,  although  originally  developed  for  an  art  program, 
is  basically  a  generic  model  that  could  be  applied  to  other  subject  areas  with  few 
modifications.  Assessment  procedures  to  measure  the  desired  student  outcomes, 
can  be  identified  and/or  developed. 

The  Art  Program  Model 

Figure  3  presents  the  Results-based  Art  Program  Han,  which  is  a  refinement  of 
Figure  2.  It  does  not  include  the  inputs  of  the  home,  community,  and  society, 
some  of  which  are  inherent  under  other  headings.  This  model  encourages  the 
teacher  to  identify  his/her  individual  mission  statement/belief.  It  stresses  the 
importance  of  inputs  into  the  program;  the  need  to  take  students  from  where  they 
are  with  the  preassessment  and  to  track  their  growth  along  the  continuum.  The  plan 
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assists  teachers  in  focusing  on  the  desired  student  outcomes  and,  through  the  use  of 
a  variety  of  assessment  procedures,  determine  the  actual  student  outcome. 

Implications 

1 .  Based  on  the  current  Hterature  and  the  practical  application,  it  has  been 
demonstrated  that  a  more  effective  model  for  school  and  program  evaluation 
involving  collaboration  and  the  identification  of  educational  quality  indicators 
can  be  designed  and  implemented. 

2.  The  development  of  a  clear  set  of  standards  or  indicators  of  educational  quality 
would  be  a  desirable  step  in  moving  the  evaluation  model  on  to  more  objective 
ground,  and  would  allow  much  more  professional  involvement  of  school  level 
personnel. 

3 .  Although  the  art  program  evaluation  was  a  practical  application  of  the  research, 
the  model  developed  could  be  applied,  with  few  modifications,  to  other  subject 
areas.  However,  assessment  procedures  would  have  to  be  identified/developed 
for  the  different  programs. 

4.  Community/stakeholder  involvement  in  the  evaluation  process  has  proven  to  be 
very  valuable  input  and  should  continue  to  be  utilized. 

Recommendations 

1 .  School  and/or  program  evaluations  should  be  designed  using  a  collaborative 
model. 

2.  School  and/or  program  evaluations  should  include  the  development  and  use  of 
educational  quality  indicators.  A  vital  component  is  the  involvement  of 
stakeholders  in  defining  what  constitutes  quality. 

3 .  School  and  program  evaluation  should  be  an  on-going  process  and  not  simply 
an  event  which  takes  place  once  every  five  years  or  so.  An  evaluation  model 
should  assure  that  program  and  school  evaluation  becomes  a  natural  and  vital 
part  of  the  curriculum  and  instruction  cycle. 
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4.  The  program  evaluation  model  that  has  been  developed  should  be  applied  to 
other  program  areas  in  Lethbridge  School  District  No.  51  and  in  other 
jurisdictions. 

5.  Further  development  and  validation  of  the  art  program  evaluation  model  should 
continue,  particularly  with  regard  to  the  refinement  of  the  educational  quality 
indicators  and  the  verification  of  student  outcomes  through  assessment 
procedures. 

6.  Teacher  training  in  the  use  of  a  variety  of  assessment  procedures  that  can  be 
employed  in  measuring  whether  students  have  achieved  the  desired  outcomes  is 
essential. 

Follow-up 

Lethbridge  School  District  No.  51  is  continuing  to  expand  the  use  of  this  model  to 
other  program  areas.  Revisions/refinements  to  the  collaborative  model  will  be  an 
ongoing  process.  The  identification  and  development  of  assessment  procedures  for 
the  measurement  of  student  outcomes  will  be  expanded  to  other  programs. 

Interest  has  been  expressed  by  the  Calgary  Public  and  Catholic  EQI  Project 
members  to  work  cooperatively  with  Lethbridge  to  merge  the  two  projects.  This 
possibility  will  be  explored. 

Closing  Statement 

As  a  result  of  the  research  project,  it  has  been  determined  that  the  former  model  of 
program  and  school  evaluation  was  not  consistent  with  the  literature  on  indicators 
of  effectiveness,  quality  and  school  improvement.  New  evaluation  models  should 
move  away  from  the  heavy  emphasis  on  a  "top  down"  approach  to  encourage  and 
empower  school  staff  and  administrators  to  be  actively  involved  and  interacting  in 
assessing  the  effectiveness  of  their  own  programs  and  in  planning  for  their 
improvement.  A  collaborative  model  for  system/program  evaluations  in  which  the 
use  of  "educational  quality  indicators"  is  a  key  component,  is  more  effective. 
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APPENDIX  B 


FORM  A 


LETHBRIDGE  SCHOOL  DISTRICT  #51 
ART  PROGRAM  EVALUATION 


TEACHER/ADMINISTRATION  QUESTIONNAIRE 


Using  the  scale  .... 

Positive      4        3        2        1      Negative        Don't  Know  ? 


How  do  you  perceive  the  importance  of  the  Art  Program  in  your 
school? 

By  administration                                       4  3        2  1? 

By  teachers                                                  4  3        2  1? 

By  students                                                  4  3        2  1? 

By  parents                                                    4  3        2  1? 


2.  FACILITIES 


Is  there  a  specialized  art  room?  Yes  No 

Rate  the  facility  you  are  presently  using: 


For  teaching  purposes 
For  storage  purposes 
Student  work  space 
For  display  areas 


1  ? 

1  ? 

1  ? 

1  ? 


3 .  BUDGET/EQUIPMENT/SUPPLIES 
Rate  the  following: 

Budget  allocation  4  3  2  1 

Ordering  procedures  in  school  4  3  2  1 

Ordering  procedures  throughout  system  4  3  2  1 

Quality  of  supplies  4  3  2  1 

Available  equipment  4  3  2  1 
Availability  of  authorized  and 

recommended  resources  4  3  2  1 

Maintenance  of  equipment /replacement  4  3  2  1 


4.     (a)     ART  INSTRUCTION  ( self -rating ) 


Rate  the  following: 


Teacher  interest  in  subject 

4 

3 

2 

1 

7 

Teacher  training 

4 

3 

2 

1 

7 

Classroom  climate 

4 

3 

2 

1 

7 
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Classroom  routines 

4 

3 

2 

1 

7 

Adherence  to  the  Program  of  Studies 

4 

3 

2 

1 

Long-range  and  unit  planning 

4 

3 

2 

1 

7 

Varied  teaching  strategies 

4 

3 

2 

1 

7 

Evaluation  procedures  (teacher) 

4 

3 

2 

1 

7 

Evaluation  procedures  ( student ) 

A 

4 

o 
o 

Z 

1 

Practices  safety  procedures 

4 

3 

2 

1 

7 

Articulation/peer  coaching 

4 

3 

2 

1 

7 

(b)     ART  INSTRUCTION  (total  program) 

Rate  the  following: 

Teacher  interest  in  subject 

4 

3 

2 

1 

7 

Teacher  training 

4 

3 

2 

1 

7 

Classroom  climate 

4 

3 

2 

1 

7 

Classroom  routines 

4 

3 

2 

1 

7 

Adherence  to  the  Program  of  Studies 

4 

3 

2 

1 

7 

Long-range  and  unit  planning 

4 

3 

2 

1 

7 

Varied  teaching  strategies 

4 

3 

2 

1 

7 

Evaluation  procedures  (teacher) 

4 

3 

2 

1 

7 

Evaluation  procedures  (student) 

4 

3 

2 

1 

7 

Practices  safety  procedures 

4 

3 

2 

1 

7 

Articulation/peer  coaching 

4 

3 

2 

1 

7 

5.     ACTIVITIES  SUPPORTED  BY  TEACHER/ SCHOOL 


Rate  the  following: 


Art  displayed  in  school 

4 

3 

2 

1 

7 

Education  week  activities 

4 

3 

2 

1 

7 

Orientation  activities 

4 

3 

2 

1 

7 

Art's  Alive  exhibits 

4 

3 

2 

1 

7 

Central  Office  exhibits 

4 

3 

2 

1 

7 

Bowman  exhibits  (Jr. /Sr.  High) 

4 

3 

2 

1 

7 

Art  tours 

4 

3 

2 

1 

7 

Special  arts  nights 

4 

3 

2 

1 

7 

Other : 
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6 .     COMMENTS : 


SCHOOL: 


Please  return  to  the  school  office  by  January  31,  1991 
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FORM  B 


SCHOOL:    GRADE:     12  3 


LETHBRIDGE  SCHOOL  DISTRICT  #51 
ART  PROGRAM  EVALUATION 
STUDENT  QUESTIONNAIRE  -  Grades  1-3 


Yes 

No 

Not 

sure 

w 

1. 

We  do  lots  of  different  kinds  of  art 

Yes 

No 

Not 

sure 

2. 

We  have  art  in  a  special  art  room 

Yes 

No 

Not 

sure 

3. 

We  have  lots  of  art  books  in  our  room 
and  in  our  library 

Yes 

No 

Not 

sure 

4. 

My  teacher  helps  me  with  my  art 

Yes 

No 

Not 

sure 

5. 

We  have  lots  of  pictures  on  the  wall 

Yes 

No 

Not 

sure 

6. 

My  art  pictures  have  been  on  the  wall 

Yes 

No 

Not 

sure 

7. 

We  talk  about  different  kinds  of  art 

Yes 

No 

Not 

sure 

8. 

My  class  has  visited  an  art  show 

Yes 

No 

Not 

sure 

9. 

I  like  my  art  class 

Yes 

No 

Not 

sure 

10. 

I  think  I  am  a  good  artist 

Yes 

No 

Not 

sure 

11. 

My  teacher  thinks  I  am  a  good  artist 

Yes 

No 

Not 

sure 

12. 

Everyone  works  hard  in  art 

Yes 

No 

Not 

sure 

13. 

I  have  time  to  finish  my  art 

Yes 

No 

Not 

sure 

14. 

I  know  how  to  take  care  of  different 
art  materials  such  as  paint  brushes, 
paints,  blue,  scissors,  pencils, 
crayons ,  etc . 

Yes 

No 

Not 

sure 
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FORM  C 


SCHOOL:   GRADE: 

LETHBRIDGE  SCHOOL  DISTRICT  #51 
ART  PROGRAM  EVALUATION 
STUDENT  QUESTIONNAIRE  -  Grades  4-6 


©©©© 


Using  the  scale,  circle  the  number 
which  best  tells  how  you  feel  about 
each  statement  with:     4  being  "best" 
or  "always  true";  3  "usually  true"; 
2  "sometimes  true";  1  "never  true" 

1.  We  can  do  many  different  kinds  of  art 
activities  with  the  art  supplies  in 

our  school  4        3        2  1 

2.  We  have  lots  of  art  books  in  our  room 

and  in  our  library  4        3        2  1 

3.  Our  class  goes  to  a  special  room  for  art         4        3        2  1 

4.  My  teacher  helps  and  advises  me  with 

my  art  projects  4        3        2  1 

5.  We  have  lots  of  student  art  displayed 
in  our  room  and  on  other  wall  in  the 

school  4        3        2  1 

6.  My  art  work  is  displayed  sometimes  4        3        2  1 

7.  We  talk  about  artists  and  their  work  4        3        2  1 

8.  There  are  pictures  by  famous  artists 

on  display  4        3        2  1 

9.  My  class  has  visited  an  art  show  4        3        2  1 

10.  Everyone  works  hard  in  art  class 

and  hardly  ever  fools  around  4        3        2  1 

11.  I  am  learning  a  lot  about  drawing, 
painting,  sculpture,  print  making 

and  other  things  in  my  art  class  4  3  2  1 

12.  I  like  my  art  class  4  3  2  1 

13.  My  teacher  thinks  I  am  a  good  artist  4  3  2  1 

14.  I  think  I  am  a  good  artist  4  3  2  1 

15.  My  teacher  has  taught  me  how  to 
take  care  of  various  art  supplies, 

e.g.,  paint  brushes,  paint,  etc.  4        3        2  1 


FORM  D 


LETHBRIDGE  SCHOOL  DISTRICT  #51 
ART  PROGRAM  EVALUATION 
STUDENT  QUESTIONNAIRE     -     GRADES  7-12 


Please  check  appropriate  box: 


Junior  High  student 
Senior  High  student 


Please  circle  the  number  which  best 
expresses  your  feeling  about  each 
statement:     4  indicates  "always 
true";  3  "usually  true"; 
2  "sometimes  true";  1  "never  true" 


1.  I  have  enough  personal  work  and 
storage  space  for  my  projects 

2.  We  have  a  variety  of  materials 
and  supplies  so  that  we  can 

do  different  kinds  of  art 

3.  We  have  a  wide  variety  of  art 
reference  books 

4.  I  get  advice  and  help  with  my  work 
from  the  teacher  and  other  students 

5.  Student  art  work  is  displayed  in 
various  areas  of  the  school 

6.  My  work  is  displayed  sometimes 

7.  We  have  special  activities  in  our 
school  about  art,  field  trips,  art 
shows,  arts  nights 

8.  I  enjoy  art 

9.  I  take  pride  in  my  work,  my 
growth  as  an  artist  and  the 
accomplishments  of  others 

10.  I  am  developing  creative  thinking 
skills  by  solving  the  problems  I 
encounter  while  doing  my  art  work 

11.  I  am  learning  how  to  communicate 
through  my  art  and  other  people ' s 
art  -  ideas,  thoughts,  emotions, 
stories,  etc. 


High  >  Low 


4  3  2  1 
4        3        2  1 
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12.  I  am  developing  an  appreciation 
for  the  arts  by  learning  about 
different  artists,  different  art 
styles  and  periods,  and  am 
developing  critiquing  skills 

13.  I  am  learning  to  value  art  by 
working  at  it,  taking  care  of  my 
my  work  and  materials 

14.  I  am  learning  the  vocabulary  of 
art  (design  elements,  design 
principles)  and  developing 
critiquing  skills 

15.  I  am  developing  ski lis/ techniques 
in  a  variety  of  studio  areas  - 
drawing,  painting,  two-dimensional 
design,  three-dimensional  design,  etc.  4        3        2  1 

16.  Others  think  I  am  progressing  and 
developing  my  ideas,  skills  and 

techniques  4        3        2  1 

Question  17  to  be  answered  only  by  senior  high  school  students. 

17.  I  am  beginning  to  establish  a 
personal  "style"  and  am  taking 
control  of  my  artistic 

development  4        3        2  1 


4  3  2  1 
4        3        2  1 

4        3        2  1 


COMMENTS : 


Are  you  planning  to  attend  college  or 

university?  Yes    Q        No    |  | 

Are  you  planning  an  art-related  career, 
e.g.,  architect,  illustrator,  fine 
artist,  interior  decorating,  fashion 

designer,  art  teacher,  window  dresser,  etc.        Yes    Q       No    |  [ 


SCHOOL: 
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FORM  E 


LETHBRIDGE  SCHOOL  DISTRICT  #51 
ART  PROGRAM  EVALUATION 
PARENT  QUESTIONNAIRE 

My  children  are  in  grades(s):     (please  circle) 

123456789       10         11  12 

Please  Circle 

1.  Are  you  aware  that  the  art  program  focus 

has  changed  from  product  to  process?  Yes  No 

2.  Are  you  aware  that  art  is  a  required 

subject  at  the  elementary  level?  Yes  No 

3.  Are  you  aware  that  there  are  specific 
concepts  and  skills  that  are  required 
by  the  provincial  curriculum  to  be 

taught  at  each  grade  level?  Yes  No 

4.  Are  you  aware  of  how  your  child  is 

evaluated  in  art?  Yes  No 

5.  Do  you  feel  that  art  is  considered  an 
important  subject  in  your  child's 

school?  Yes  No 

6.  Do  you  find  art  attractively  displayed 

in  your  child's  school?  Yes  No 

7.  Has  your  child  experienced  working  with 

a  variety  of  art  materials?  Yes  No 

8.  Have  you  or  your  child  attended  any 
special  art  activities,  e.g.,  field 
trips,  art  exhibits,  resource  people, 

etc.  Yes  No 

9.  Does  your  child  enjoy  art?  Yes  No 

10.  Do  you  feel  that  your  child  is 
developing  understanding  and 

skills  in  art?  Yes  No 

11.  Does  your  child  value  art?  Yes  No 

12.  Does  your  child  bring  his/her 

art  work  home?  Yes  No 
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13.     Is  your  child  developing  respect 
and  appreciation  for  the  art  work 

of  others?  Yes  No 

COMMENTS : 


Questions  14  and  15  to  be  answered  only  by  parents  of  secondary 
students 

14.  Does  your  child  strive  for  excellence 

in  art  projects?  Yes  No 

15.  Would  you  approve  of  your  pursuing 
an  art-related  career,  e.g., 
architect,  illustrator,  fine  artist, 
interior  decorator,  art  teacher, 

window  dresser,  etc.?  Yes  No 

High  >  Low 

16.  Overall  rating  of  your  child's 

school  art  program  4        3        2  1 

SCHOOL:   


Please  return  to  your  child's  teacher  by  January  31,  1991. 
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FOLLOW-UP  QUESTIONNAIRE 
TO  THE 

COLLABORATIVE  ART  PROGRAM  EVALUATION 
1.  What  are  the  strengths  of  this  evaluation  procedure? 


2.  What  are  the  weaknesses  of  this  procedure? 


3.  Suggestions/Recommendations  as  a  result  of  your  experience 
with  this  new  procedure. 


4.  Please  comment  on  your  personal  involvement  in  the  evaluation. 


( Thank  you  for  your  co-operation  both  with  the  evaluation  and  for 
taking  the  time  to  complete  and  return  this  follow-up 
questionnaire.  Please  return  this  form  to  Central  Office  at  your 
earliest  convenience. ) 


57 


APPENDIX  C 


1990-91  Art  Evaluation   Lethbrid^^  School  District  #51 


Teacher/ Administration  Questionnaire 

4 

3 

2 

1 

Don't 
Know 

1.   How  do  you  perceive  the  importance  of  the  Art 
program  in  your  school?  (a)  By  administration 

42 

45% 

34 

36% 

9 

10% 

2 

2% 

7 

7% 

(b)  By  teachers 

36 

38% 

49 

52% 

8 

9% 

1 

1% 

(c)  By  students 

37 

40% 

46 

49% 

9 

10% 

1 

1% 

(d)  By  parents 

16 

17% 

35 

38% 

26 

28% 

1 

15  116% 

2.   FACILITIES  Rate  the  facility  you  are  presently 
using:  (a)  For  teaching  purpioscs 

31 

34% 

41 

45% 

15 

16% 

4 

4% 

1 
1 

1% 

(b)  For  storage  purposes 

17 

18% 

40 

43% 

27 

29% 

6 

7% 

2 

(c)  Student  work  space 

25 

27% 

33 

36% 

19 

21% 

13 

14% 

1 

1  vC 

(d)  For  display  areas 

19 

21% 

39 

42% 

24 

26% 

10 

11% 

3.   BUDGET/EQUIPME>rr/SUFPLIES  Rate  the 
following:  (a)  Budget  allocation 

16 

18% 

45 

49% 

12 

13% 

2 

2% 

16 

18% 

(b)  Ordering  procedures  in  school 

26 

29% 

51 

56% 

7 

8% 

1 

1% 

6 

7% 

(c)  Ordering  procedures  throughout  system 

6 

7% 

34 

38% 

11 

U% 

2 

2% 

37 

41% 

(d)  Quality  of  supplies 

19 

21% 

52 

57% 

7 

8% 

5 

5% 

8 

9% 

(e)  Available  equipment 

16 

18% 

50 

56% 

15 

17% 

3 

3% 

5 

6% 

(f)  Availability  of  recommended  resources 

19 

21% 

45 

50% 

19 

21% 

2 

2% 

5 

6% 

(g)  Maintenance  of  equipment/replacement 

16 

18% 

49 

55% 

14 

16% 

3 

3% 

7 

8% 

4.   ART  INSTRUCTION  (self-rating)  Rate  tlic 
following:  (a)  Teacher  mtcrest  m  subject 

39 

45% 

37 

43% 

8 

9% 

1 

1% 

2 

2% 

(b)  Teacher  training 

17 

20% 

28 

32% 

33 

38% 

6 

7% 

3 

3% 

(c)  Classroom  climate 

29 

34% 

50 

58% 

5 

6% 

0 

2 

2% 

(d)  Classroom  routines 

26 

30% 

54 

63% 

4 

5% 

0 

2 

2% 

{Q)  Aonerence  to  tne  rrogram  ot  ocuoies 

25 

28% 

44 

50% 

10 

11% 

1 

1% 

8 

9% 

[^L)  lA^ng-rangc  oc  unu  planning 

25 

28% 

40 

45% 

15 

17% 

2 

2% 

6 

7% 

(g)  Varied  teaching  strategies 

25 

29% 

44 

51% 

14 

16% 

0 

4 

5% 

(h)  Evaluation  procedures  (teacher) 

13 

15% 

49 

56% 

18 

21% 

0 

7 

8% 

(i)  Evaluation  procedures  (student) 

3 

3% 

47 

54% 

25 

29% 

4 

5% 

8 

9% 

(j)  Practices  safety  procedures 

38 

44% 

39 

45% 

2 

2% 

2 

2% 

6 

7% 

(k)  Articulation/peer  coadiing 

16 

19% 

48 

56% 

11 

U% 

3 

4% 

7 

8% 

4.  ART  INSTRUCTION  (total  program).  Rate  the 
following:  (a)  Teacher  mtcrest  in  subject 

25 

29% 

45 

52% 

13 

15% 

0 

3 

3% 

(b)  Teacher  training 

19 

22% 

25 

28% 

32 

36% 

4 

5% 

g 

9% 

(c)  Classroom  climate 

17 

19% 

60 

68% 

6 

7% 

0 

6% 

(d)  Classroom  routines 

22 

25% 

55 

63% 

5 

6% 

0 

5 

6% 

(e)  Aonerence  to  tne  rrogram  ot  otudies 

20 

23% 

47 

54% 

10 

11% 

0 

10 

11% 

(f)  Long-range  &  unit  planning 

23 

26% 

37 

43% 

10 

11% 

1 

1% 

16 

xw 

18% 

(g)  Varied  teaching  strategies 

18 

21% 

46 

53% 

9 

10% 

0 

13 

Xa9 

15% 

(h)  Evaluation  procedures  (teacher) 

9 

10% 

46 

53% 

17 

20% 

X 

1% 

14 

16% 

(i)  Evaluation  procedures  (student) 

( 

7% 

52 

60% 

12 

14% 

1 

1% 

16 

18% 

(j)  Practices  safety  procedures 

29 

33% 

41 

47% 

4 

5% 

1 

1% 

12 

14% 

(k)  Articulatkm/peer  coaching 

15 

17% 

52 

58% 

9 

10% 

1 

1% 

U 

14% 

5.  ACTlVmES  SUPPORTED  fiV  TEaCHER/ 
SCHOOL  Rate  the  foUowiag; 
(a)  Art  displayed  in  school 

51 

55% 

27 

29% 

10 

11% 

1 

1% 

3 

3% 

(b)  Educauon  week  activities 

48 

53% 

29 

32% 

7 

8% 

0 

7 

8% 

(c)  Orientation  activities 

24 

26% 

29 

32% 

14 

15% 

0 

25 

27% 

ATt\  Alive  exhihit 

29 

32% 

39 

43% 

9 

10% 

0 

14 

15% 

(e)  Central  office  odiibits 

21 

24% 

22 

25% 

18 

21% 

5 

6% 

21 

24% 

(f)  Bowman  esdxibits  Qr/sr  high) 

12 

15% 

11 

14% 

11 

14% 

5 

6% 

42 

52% 

(g)  Art  tours 

7 

8% 

18 

21% 

17 

20% 

12 

14% 

32 

37% 

(h)  Special  arts  nights 

11 

13% 

U 

14% 

4 

5% 

16 

18% 

44 

51% 

1003 

25% 

i8ie 

46% 

584 

15% 

122 

3% 

469 

11% 

2.    FACILmES  Is  there  a  specialized  art  room?  Yes  No 

74  78%     21  22% 


1990-91  Art  Evaloatlon  Lefhbridge  Scliool  District  #51 


Parent  Questionnaire  (Grades  1  -  6) 

Yes 

No 

1.   Are  you  aware  that  the  art  program  focus  has  changed  from 
product  to  process? 

156 

17% 

758 

2.   Are  you  aware  that  art  is  a  required  subject  at  the 

764 

83% 

154 

X  J^ 

3.   Are  you  aware  that  there  are  specific  cpncepts  and  skills 

that  are  reouired  hv  the  nrnvinrial  curridilurn  to  he 

taught  at  each  gradie  level? 

5U 

56% 

405 

44% 

4     Ar^  vnu  aware  of  how  voiir  child  vi  evaluated  in  art'' 

174 

19% 

740 

80% 

5.   Do  you  feel  that  art  is  considered  an  important  subject  in 

voiir  rhild*<k  vJiool*' 

765 

87% 

114 

6.   Do  you  find  art  attractively  displayed  in  your  child's 

SCQlJUl ' 

871 

96% 

27 

03% 

^             voiir  rhild  ^Tn^rienf*ed  worIrin<T  with  a  varietv  of  art 

materials? 

783 

89% 

91 

10% 

Have  voii  or  voiir  child  attended  anv  ^necial  art  activities- 

e.g.,  field  trips,  art  exhibits,  resource  people,  etc? 

463 

51% 

433 

48% 

9.  Does  your  child  enjoy  art? 

858 

95% 

38 

04% 

10.   Do  you  feel  that  your  child  is  developing  understanding 
and  skills  in  art? 

780 

90% 

80 

09% 

11.  Does  your  child  value  art? 

787 

90% 

87 

09% 

12.   Does  your  child  bring  his/her  art  work  home? 

808 

91% 

79 

08% 

13.  Is  your  child  developing  respect  and  appreciation  for  the 
art  work  of  others? 

748 

91% 

69 

08% 

14.  Does  your  child  strive  for  excellence  in  art  projects? 

180 

86% 

27 

13% 

15.  Would  you  approve  of  your  diiki  oursuing  an  art>related 
career,  e.g^  architect,  illustrator,  mie  artist,  interior 
decorator,  art  teacher,  window  dresser,  etc? 

183 

88% 

24 

11% 

8833 

73% 

3126 

26% 

High   >  Low 

4  3  2  1 

16.    Overall  rating  of  your  diild't  school  art  program  151  21%    481  66%    89  13%      7  0% 
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1990-91  Art  Evalgation   LdhlMridge  Sctort  District  #51 


Student  Questiomiaire  (Grades  1  -  3) 

Yes 

No 

Not 
Sure 

1.     We  do  lots  of  dinerent  kinds  of  art 

726 

89% 

17  02% 

68 

08% 

2.   We  have  art  in  a  special  art  room 

376 

46% 

349 

43% 

82 

10% 

3.   We  have  lots  of  art  books  in  our  room  and  in  our  library 

423 

53% 

90 

11% 

283 

35% 

4.   My  teacher  helps  me  with  my  art 

655 

83% 

74 

09% 

55 

07% 

5.   We  have  lots  of  pictures  on  the  wall 

685 

86% 

52 

06% 

52 

06% 

6.   My  art  pictures  have  been  on  the  wall 

692 

88% 

43 

05% 

49 

06% 

7.   We  talk  aoout  dinerent  kmos  oi  an 

605 

77% 

61 

07% 

117 

14% 

8.   My  class  has  visited  an  art  show 

177 

22% 

532 

68% 

71 

09% 

9.   I  like  my  art  class 

686 

88% 

4^ 

50 

06% 

10.   I  think  I  am  a  good  artist 

567 

73% 

QA 

122 

15% 

11.   My  teacher  thinks  I  am  a  good  artist 

534 

68% 

32 

04% 

209 

26% 

12.   Everyone  works  hard  in  art 

600 

77% 

48 

06% 

124 

16% 

13.   I  have  time  to  finish  my  art 

573 

75% 

91 

11% 

95 

u% 

14.  I  know  how  to  take  care  of  different  art  materials  such  as 
paint  brushes,  paints,  glue,  sdssors,  pencils,  aayons,  etc. 

671 

89% 

26 

03% 

54 

07% 

15.   1  think  I  am  a  good  artist 

593 

80% 

110 

14% 

36 

04% 

88U 

70% 

1905 

15% 

1718 

13% 

#4 


1990-91  Alt  Evalnallon   Lethbridge  School  Digtrtct  #51 


Student  Qucstioiiiiaire  (Grade  4-6) 

4 

3 

2 

1 

1.  We  can  do  many  different  kinds  of  art  activities  with  the  art 
supplies  in  our  school 

455 

52% 

324 

37% 

80 

09% 

13 

01% 

2.   We  have  lots  of  art  books  in  our  room  and  in  our  library 

203 

23% 

290 

33% 

261 

30% 

100 

11% 

3.   Our  class  goes  to  a  special  room  for  art 

328 

38% 

226 

26% 

191 

22% 

100 

11% 

4.   My  teacher  helps  and  advises  me  with  my  art  projects 

490 

57% 

253 

29% 

91 

10% 

20  ^% 

5.  We  have  lots  of  student  art  displayed  in  our  room  and  on 
other  walls  in  the  school 

479 

56% 

240 

28% 

114 

13% 

19  L% 

6.  My  art  work  is  displayed  sometimes 

364 

42% 

243 

28% 

161 

18% 

 \  

82  ^ 

7.  We  talk  about  artists  and  their  work 

183 

22% 

212 

25% 

256 

30% 

178 

21% 

8.  There  are  pictures  by  famous  artists  on  display 

100 

11% 

125 

14% 

185 

22% 

429 

51% 

9.  My  class  has  visited  an  art  show 

69 

08% 

79 

09% 

104 

12% 

559 

S8% 

10.  Everyone  works  hard  in  art  class  and  hardly  ever  fools  around 

131 

15% 

247 

29% 

327 

38% 

U9 

16% 

11.  I  am,  learning  a  lot  about,  drawing,  painting,  sculpture,  print 
making  and  Other  yH«wg«  in  my  ait  class 

458 

54% 

236 

28% 

116 

13% 

30 

03% 

12.  I  like  my  art  class 

487 

64% 

163 

21% 

81 

10% 

26 

03% 

13.  My  teacher  thinks  I  am  a  good  artist 

282 

34% 

304 

36% 

179 

21% 

61 

07% 

14.  I  think  I  am  a  good  artist 

341 

41% 

228 

27% 

165 

19% 

94 

11% 

15.  My  teacher  has  tau^  me  how  to  take  care  of  various  art 
supplies,  e.g.,  paint  t>nishes,  paint,  etc 

507 

62% 

189 

23% 

83 

10% 

37 

04% 

4877 

38% 

3359 

26% 

2394 

19% 

1887 

15% 

61 
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1990-91  Art  Evaloatlon  Lethbridge  Schooi  Plitrict  #51 


Student  QiMStioiiiuire  (Grade  7>  12) 

4 

3 

2 

1 

1.  I  hive  enough  personal  work  and  storage  space  for  my 
projecu 

102 

26% 

194 

51% 

71 

18% 

11 

02% 

2.   We  have  a  variety  of  materials  and  supplies  to  that 
we  can  do  different  kinds  of  art 

54% 

145 

38% 

22 

05% 

3 

00% 

3.   We  have  a  wide  variety  of  art  reference  books 

84 

22% 

164 

44% 

98 

26% 

24 

06% 

4.  I  get  advice  and  help  with  my  work  from  the  teacher 
and  other  students 

222 

58% 

118 

31% 

31 

08% 

7 

01% 

5.  Student  art  work  is  displayed  in  various  areas  of  the  school 

249 

66% 

92 

24% 

22 

05% 

10 

02% 

6.  My  work  is  displayed  sometimes 

68 

18% 

U9 

35% 

89 

24% 

75 

20% 

7.  We  have  special  activities  in  our  school  about  art, 
field  tripe,  art  showi,  arts  nights 

75 

20% 

m 

30% 

99 

27% 

79 

21% 

8.  I  enjoy  art 

227 

61% 

111 

30% 

24 

06% 

7 

01% 

9.  I  take  pride  in  my  work,  my  growth  as  an  artist  and 
the  accomplishments  of  others 

173 

46% 

157 

41% 

38 

10% 

7 

01% 

10.  I  am  developing  creative  thinking  skills  by  soKing 
the  problems  1  encounter  while  doing  my  art  work 

117 

31% 

196 

52% 

51 

13% 

8 

02% 

IL  I  am  learning  how  to  communicate  through  my  art  and 
other  peoples  art  •  ideas,  thoughts,  emotions,  stories,  etc 

74 

19% 

197 

53% 

79 

21% 

21 

05% 

12.  I  am  developing  an  appreciation  for  the  arts  by  learning 
about  different  artists,,  different  art  styles  and  periods 
and  am  develooinfl  oitiauinfl  skills 

105 

28% 

185 

49% 

72 

19% 

9 

02% 

13.  I  am  leaning  to  value  art  by  working  at  it,  taking 
care  of  my  work  and  materials 

180 

48% 

150 

40% 

38 

10% 

2 

00% 

14.  I  am  learning  the  vocabulaiv  of  ait  (design  elements, 
design  prinaples)  and  devefoping  critiquing  skiUt 

143 

38% 

153 

41% 

64 

17% 

7 

01% 

15.  I  am  developing  skills/techniques  ia  a  viriety  of  UnSo 
areas  •  drawing,  painting,  two-dimrminnal  oesigii, 
three-dimensionaT  design,  etc 

169 

45% 

149 

40% 

41 

11% 

11 

02% 

16.  Others  think  I  am  pffrgrftsing  and  developing  my  ideaa, 
skills  and  techniques 

97 

27% 

170 

48% 

61 

17% 

22 

06% 

17.  (Sr.  High  Only)  I  am  beginninc  to  establish  a  personal 
style*  and  am  taking  control  oi  my  artistic  development 

52 

29% 

88 

50% 

29 

16% 

5 

02% 

Are  you  planning  to  attend  college  or  university?             Yet  No 

254  86%  39  13% 

Are  you  planning  an  art-related  career?                        Yes  No 

119  45%  142  54% 
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1990-91  Alt  Evaluation   Lethbridge  School  District  #51 


Pinat  QocstiooBaire  (Grades  7-12) 

Yes 

No 

L  Are  vou  awire  that  tlie  art  program  focus  hai  changed  from 
product  to  process? 

40 

13% 

218  |84% 

2.  Are  you  aware  that  art  is  a  required  subject  at  the 
elementary  level? 

206 

80% 

50 

19% 

3.  Are  you  aware  that  there  are  specific  concepts  and  skills 
that  are  required  by  the  provincial  curriculum  to  be 
taught  at  each  grade  level? 

164 

64% 

89 

35% 

4.  Are  you  aware  of  how  your  child  is  evaluated  in  art? 

73 

28% 

179 

71% 

5.  Do  you  feel  that  art  is  considered  an  important  subject  in 
your  child's  school? 

213 

86% 

34 

13% 

6.  Do  you  find  art  attractively  di^>layed  in  your  child's 
school? 

237 

97% 

6 

02% 

7.  Has  your  child  experienced  working  with  a  variety  of  art 
materials? 

216 

88% 

28 

11% 

8.  Have  vou  or  your  child  attended  any  special  art  activities, 
e.g^  deld  trips,  art  exhibits*  resource  people,  etc.? 

1^ 

112 

45% 

9.  Does  your  child  enjoy  art? 

7 

02% 

10.  Do  you  feel  that  your  child  is  developing  understanding 
and  skills  in  art? 

7 

02% 

11.  Does  your  child  value  art? 

25 

10% 

12.  Does  your  child  bring  his/her  tit  work  home? 

226 

93% 

16 

06% 

13.  Is  your  child  developing  respea  and  appredadoa  for  the 
art  work  of  others?^ 

197 

89% 

24 

10% 

i^*   uocm  jQur  cxuKi  suTvc  lOT  Cjtccuciicc  in  m  projGcux 

» 

90% 

9 

09% 

career,  e.g.,  architect,  illustrator,  fine  artat.  interior 
decorator,  art  teacher,  window  dresser,  etc? 

86 

87% 

12 

12% 

2S67 

75% 

827 

25% 

High   >  Low 

4  3  2  1 

16.    Overall  rating  of  your  chilcf  t  school  art  program  48  24%    121  61%    26  13%      1  00% 
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SAMPLE    OF    RESPONSES    TO    THE    FOLLOWUP    ART    PROGRAM  EVALUATION 

QUESTIONNAIRE 


(46  responses  to  150  questionnaires  distributed.) 


1.  Strengths:  Involvement  of  staff;  involvement  of  stakeholders; 
the  opportunity  to  provide  input;  very  calm,  non-threatening 
process;  positives  are  emphasized;  outcomes  clearly  identified 
with  assessment  procedures  to  verify;  builds  staff  morale  and 
cooperation  to  improve  together  in  team  planning  and  team 
teaching;  development  of  the  indicators;  system  wide  instead  of 
individual  schools-everyone  benefited  from  the  process;  short 
period  of  time  required  for  the  evaluation  process;  many  teachers 
felt  more  comfortable  with  collegues  than  if  only  an  external 
team  was  involved;  the  team  approach  gave  a  wide  enough 
perspective;  use  of  practising  teachers  helps  to  keep  the 
evaluation  at  a  realistic  level;  the  team  approach  gave  the 
evaluators  a  chance  to  discuss  perceptions  of  the  art  program; 
the  Thurday  morning  team  meeting  with  everyone  was  an  excellent 
idea;  we  became  more  knowledgeable  about  other  schools;  good 
balance  between  expert /trained  teachers  in  art  and  some  without  a 
broad  background;  pointed  out  quite  clearly  the  strengths  and 
weaknesses  of  the  programs  in  the  city;  impressed  with  the 
results/findings;  the  variety  and  diversity  of  the  art  work  done 
and  the  programs  which  have  been  developed; involvement  of  a 
variety  of  people-teachers,  consultants,  primary/secondary, 
generalists  etc. 

2.  Weaknesses:  Teachers  still  feel  insecure  about  their  program; 
checking  of  the  validity/reliability  of  the  survey  forms  used; 
first  time  evaluators  and  teachers  that  were  hearing  about 
outcome  based  education,  quality  indicators  etc.  for  the  first 
time  would  benefit  from  even  more  extensive  training;  perhaps 
elementary  and  secondary  teachers  should  have  worked  separately; 
I  found  the  time  frame  a  little  short;  different  teams  may 
interpret  situations  differently;  and  many  returns  indicated  no 
weakness  indicated. 

3.  Suggestions/Recommendations:  All  principals  need  to  play  an 
active  role;  one  external  team  takes  longer  but  perhaps  there  is 
more  reliability  and  consistency? -they  do  it  more  often;  would 
like  to  see  the  use  of  more  external  evaluators  who  are 
specialists  (secondary  level);  more  time  for  talking;  if  teachers 
could  be  freed  up  in  small  groups,  they  would  benefit  more  and 
could  feed  off  each  other  for  ideas;  more  time  together-the 
evaluation  team  ( external )  should  have  time  to  meet  for  a  longer 
period  of  time  with  the  teachers  in  the  schools;  again,  a  large 
number  of  forms  were  returned  with  no  response  to  this  question. 
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4.  I  found  this  experience  to  be  invaluable. 

I  received  a  tremendous  inservice  and  appreciation  for  our  art 
programs . 

I  liked  the  process.  A  much  better  procedure. 
A  terrific  learning  experience. 

Provided  an  excellent  inservice  for  teachers/administrators. 

The  evaluation  was  a  personal  learning  experience  in  the  area  of 

teaching  art. 

Very  exciting  and  encouraging.  Maybe  we  are  finally  going  to  get 
this  evaluation  stuff  right. 

Excellent  learning  and  motivating  experience. 

A  valuable  learning  experience.    Now  we  need  even  more  training 
and  the  opportunity  to  followup  on  the  recommendations. 
Wonderful   experience  but  I   still  need  to  work  on  indicators  and 
how  to  measure  them.  Very  worthwhile. 

(There  were  many  additional  comments  similar  to  the  above. ) 
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APPENDIX  D 


ELEMENTARY  STUDENT  SURVEY  RESULTS 


Yes 

No 

Not 
Sure 

1. 

I  go  to  my  school  library  as  often 
as  I  like. 

470 
37% 

544 
43% 

238 
19% 

2. 

I  usually  go  to  the  library: 

a)  once  a  day 

b)  every  few  days 

c)  once  a  week 

d)  less  than  once  a  week 

123 
9% 
404 
31% 
633 
49% 
107 
8% 

3. 

I  usually  go  to 
a  book. 

the 

library  to 

find 

1078 
85% 

186 
14% 

1 
0% 

4. 

I  usually  go  to 
( look  around) . 

the 

library  to 

KJJ»  \— '  W  O  w 

539 
42% 

715 
56% 

10 
0% 

5. 

I  usually  go  to 

the 

library  to 

read . 

716 
56% 

539 
42% 

9 
0% 

6. 

I  usually  go  to 
exchange  books. 

the 

library  to 

867 
68% 

389 
30% 

5 
0% 

7. 

I  usually  go  to 
with  others. 

the 

library  to 

319 
25% 

936 
74% 

7 
0% 

8. 

I  usually  go  to 
at  centres. 

the 

library  to 

work 

354 
28% 

902 
71% 

6 
0% 

9. 

I  usually  go  to 
research. 

the 

library  to 

do 

560 
44% 

693 
54% 

9 
0% 

10. 

I  usually  go  to 
on  the  computer. 

the 

library  to 

work 

530 
42% 

718 
57% 

10 
0% 

11. 

I  usually  go  to 
magazines. 

the 

library  to 

read 

341 
27% 

901 
72% 

8 
0% 

12. 

I  can  always  find  an  adult  in  the 
library  to  help  me. 

865 
72% 

171 
14% 

152 
12% 

13. 

In  my  library  there 
for  free  reading. 

are  lots  of  books 

610 
84% 

50 
6% 

66 
9% 

14. 

I  can  find  many  books 

to  read. 

1045 
87% 

82 
6% 

74 
6% 

15. 

I  enjoy  reading  library  books. 

1072 
88% 

79 
6% 

59 
4% 
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Yes 

No 

Not 
Sure 

16. 

My  library  has  lots  of  books  for 
getting  information  to  write  reports. 

934 
76% 

86 
7% 

193 
15% 

17. 

My  library  has  lots  of  information 
to  help  me  find  answers  to  questions. 

910 
75% 

88 
7% 

210 
17% 

18. 

My  library  has  lots  of  other  material 
(besides  books)  for  getting  informa- 
tion. 

877 
72% 

117 
9% 

213 
17% 

19. 

The  teacher-librarian  teaches  me 
how  to  use  the  library. 

872 
72% 

185 
15% 

153 
12% 

20. 

My  classroom  teacher  teaches  me 
how  to  use  the  library. 

633 
52% 

353 
29% 

212 
17% 

21. 

I  can  locate  library  material  by 
myself. 

780 
63% 

225 
18% 

215 
17% 

22. 

I  am  able  to  take  out  the  things 
I  need  from  the  library. 

796 
64% 

168 
13% 

263 
21% 
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ELEMENTARY  SUMMARY  -  PARENT  QUESTIONNAIRE 


Yes 

No 

Not 

1. 

My  child's  school  library  is  open 
Ljh^n  h^/^h<a  n^^ds  "to  use  i"fc 

411 

\j  J  ^ 

89 

98 

2. 

My  child's  school  library  contains  a 
wide  variety  of  resources,  i.e., 
books     tanes     filmstrins  maaazines 
files,  etc.  which  meet  his/her  needs  and 
interests  as  a  learner. 

398 
73% 

23 
4% 

127 
23% 

3. 

There  is  always  an  adult  available 
to  help  my  child. 

368 
68% 

46 
8% 

131 
24% 

4. 

The  school  library  has  enough 
resources  available  so  that  my  child 
is  able  to  complete  assignments. 

299 
57% 

66 
13% 

160 
30% 

5. 

My  child  is  able  to  find  materials 
on  his/her  own  in  the  library. 

379 
69% 

48 
9% 

121 
22% 

6. 

The  resources  in  the  school  library 
are  up-to-date. 

236 
43% 

30 
5% 

280 
51% 

7. 

My  child  feels  comfortable  going  to 
and  using  the  school  library. 

490 
90% 

18 
3% 

38 
7% 

8. 

My  child  is  able  to  borrow  what 
he/she  needs  from  the  school  library. 

420 
77% 

53 
10% 

72 
13% 

9. 

My  child  uses  the  school  library 
more  than  the  public  or  other 
library. 

395 
72% 

125 
23% 

30 
5% 

10. 

My  child  is  encouraged  to  use  resources 
beyond  those  provided  by  the  school 
library. 

388 
71% 

45 
8% 

113 
21% 

11. 

The  school  library  is/was  an  integral 
part  of  my  child's  education  in 
-  elementary 

440 
82% 

20 
4% 

74 
14% 

12. 

The  school  library  should  be  an  integral 
part  of  my  child's  education  in 
-  elementary 

502 
93% 

7 
1% 

30 
6% 
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SECONDARY  STUDENT  SURVEY  RESULTS 


Yes 

No 

Not 
Sure 

1 . 

My  library  is  open  when  I  need  it. 

596 
71% 

109 
12% 

134 
15% 

2 . 

I 
a 

spend  time  in  the  library  because 
teacher  takes  my  class. 

540 
66% 

242 
29% 

28 
3% 

3. 

I  spend  time  in  the  library  by  my 
own  choice. 

456 
59% 

295 
38% 

21 
2% 

4. 

I 
I 

spend  time  in  the  library  because 
am  "kicked  out"  of  class. 

78 
10% 

663 
87% 

19 
2% 

5. 

I  spend  time  in  the  library  outside 
class  time. 

247 
32% 

492 
64% 

23 
3% 

6. 

I 

usually  go  to  the  library  to: 
a )  study 

453 
60% 

284 
37% 

16 
2% 

7. 

b )  browse 

311 
42% 

410 
55% 

16 
2% 

8. 

c )  read 

344 
46% 

383 
51% 

11 
1% 

9. 

d)  visit  others 

374 
50% 

341 
46% 

19 

2% 

10. 

e)  do  research 

494 
65% 

248 
33% 

8 
1% 

11. 

f)  do  homework 

395 
53% 

331 
45% 

8 
1% 

12. 

g)  exchange  books 

341 
46% 

382 
51% 

15 
2% 

13. 

h)  read  magazines 

351 
46% 

370 
49% 

27 
3% 

14. 

Library  personnel  are  always 
available  to  help  me  if  I  need  help. 

499 

177 

O  O  Q. 

22% 

117 
14% 

15. 

The  librarian  teaches  me  how  to 
use  the  library. 

466 
61% 

180 
23% 

106 
14% 

16. 

The  librarian  teaches  me  how  to 
find  books,   filmstrips,  etc. 

464 
64% 

175 
24% 

86 
11% 
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Yes 

No 

Not 
Sure 

1  7 

Mv  librarv  has  a  wid©  varietv  of 
resources  which  I  can  read  for: 
a )  en j  oyment 

482 
67% 

159 
22% 

74 
10% 

18. 

b)  interest 

472 
65% 

184 
25% 

69 
9% 

19. 

c )  information 

541 
73% 

134 
18% 

60 
8% 

20 

Mv  librarv  has  adeciuate  resources  to 
assist  me  with  research  and  homework: 
a )  books 

592 
78% 

102 
13% 

64 
8% 

21. 

b)  filmstrips,  videos 

453 
61% 

169 
23% 

110 
15% 

22. 

c)  files 

459 
62% 

158 
21% 

116 
15% 

23. 

d)  magazines 

498 
67% 

141 
19% 

100 
13% 

24. 

My  library  has  resources  which  are 
up— to— date • 

371 
47% 

171 
21% 

246 
31% 

25. 

My  classroom  teacher  helps  me  when 
mv  class  is  workina  in  the  librarv 

577 
71% 

115 
14% 

116 
14% 

26. 

My  school  library  is  a  good  place 
for  work  and  study. 

589 
73% 

85 
10% 

122 
15% 

27. 

I  know  how  to  find  materials  in  my 
school  library. 

640 
80% 

77 
9% 

80 
10% 

28. 

I  can  find  a  place  to  work  when  I  go 
to  our  school  library. 

659 
82% 

75 
9% 

65 
8% 

29. 

I  am  able  to  take  out  the  things  I 
need  from  the  library. 

538 
67% 

141 
17% 

118 
14% 

30. 

My  teacher  encourages  me  to  use  our 
school  library. 

463 
58% 

220 
27% 

113 
14% 

31. 

I  am  encouraged  to  use  resources 
beyond  those  provided  by  our  school 
library. 

455 
56% 

191 
23% 

158 
19% 

32. 

I  use  the  public  or  other  library 
more  than  my  school  one. 

413 
52% 

288 
36% 

91 
11% 
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ET  L 

ET 

JHTL 

JHT 

SHTL 

SHT 

33 . 

Who  taught  you  how  to: 

a) 

use  the  card 

489 

133 

88 

20 

21 

7 

catalogue? 

64% 

17% 

11% 

2% 

2% 

0% 

34. 

b) 

find  books  on  the 

478 

114 

103 

38 

17 

11 

shelf? 

62% 

14% 

13% 

4% 

2% 

1% 

35. 

c) 

find  relevant  books 

which  provide  infor- 

mation for:  homework 

ZD  / 

1  1  R 

1  QQ 

xzo 

ZO 

1  A 

1  D 

research  and  writing 

35% 

15% 

26% 

16% 

3% 

2% 

reports? 

36. 

d) 

take  notes  from 

149 

138 

153 

224 

19 

44 

books  or  films,  etc? 

zU^ 

lo^ 

Zl^ 

z* 

37. 

e) 

organize  eg.  outline. 

webbing,   etc.  and 

1Z4 

1  /I  Q 

I  1  "7 

II  / 

O  Q  >l 

zy4 

lU 

bo 

write  a  report  from 

16% 

19% 

15% 

39% 

1% 

7% 

notes? 

38. 

f ) 

write  a  bibliography? 

139 

154 

107 

276 

18 

47 

18% 

20% 

14% 

37% 

2% 

6% 

39. 

g) 

present/share  a 

112 

189 

103 

283 

15 

50 

report? 

14% 

25% 

13% 

37% 

1% 

6% 

ET 
JHT 


-  Elementary  Teacher 


-  Junior  High  School  Teacher  SHST 


Librarian 


Senior  High  School 
Teacher 
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SECONDARY  SUMMARY  PARENT  QUESTIONNAIRE 


Yes 

No 

Not 
Sure 

1. 

My  child's  school  library  is  open 
when  he/she  needs  to  use  it. 

107 
69% 

19 
12% 

30 
19% 

Z  . 

My  child's  school  library  contains  a 
wide  variety  of  resources,  i.e., 
books,  tapes,   filmstrips,  magazines, 
files,  etc.  which  meet  his/her  needs  and 
interests  as  a  learner. 

/U 
55% 

±Z 

10% 

A  A 

35% 

O  . 

There  is  always  an  adult  available 
to  help  my  child. 

lU  / 

69% 

ID 

10% 

oz 
21% 

A 

*±  • 

ine  scnooj.  ±j.uraxy  nas  enougn 
resources  available  so  that  my  child 
is  able  to  complete  assignments. 

80 
52% 

27 
17% 

48 
31% 

5. 

My  child  is  able  to  find  materials 
on  his/her  own  in  the  library. 

113 
73% 

15 
10% 

27 
17% 

b . 

The  resources  in  the  school  library 
are  up-to-date. 

OD 

36% 

Zo 
15% 

/  D 
49% 

7. 

My  child  feels  comfortable  going  to 
and  using  the  school  library. 

113 

19 
12% 

23 
15% 

8. 

My  child  is  able  to  borrow  what 
he/she  needs  from  the  school  library. 

109 
70% 

21 
14% 

25 
16% 

9. 

My  child  uses  the  school  library 
more  than  the  public  or  other 
library. 

81 

53%. 

61 
39% 

13 
8% 

10. 

My  child  is  encouraged  to  use  resources 
beyond  those  provided  by  the  school 
library. 

Ill 
68% 

16 
10% 

36 
22% 

11. 

The  school  library  is/was  an  integral 
part  of  my  child's  education  in 
-  junior  high 

114 
74% 

19 
12% 

22 
14% 

12. 

The  school  library  should  be  an  integral 
part  of  my  child's  education  in 
-  junior  high 

137 
89% 

6 
4% 

11 
7% 

72 


13.  Have  you  every  volunteered  to  assist  in 
the  library? 

14.  Do  you  feel  there  is  adequate  teacher 
direction  and  supervision  when  students 
are  in  the  library? 


Yes 

No 

Not 

Yes 

No 

Not 

Sure 

Sure 

22 

124 

8 

4 

32 

2 

14% 

81% 

5% 

11% 

84% 

5% 

80 

17 

55 

25 

3 

11 

53% 

11% 

36% 

64% 

8% 

28% 

High  Low 

15.       Overall  rating  of  the  school  library  program        4      3        2  1 

27  85         23  2 

20%  62%  17%  1% 
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IMPRESSIONISTIC  SCORING 


A  5  Appreciates  the  work  of  others  and  self.  Accepts 
T  direction. 

T  4        Usually  appreciates  the  work  of  self  and  others.  Often 
I  accepts  direction. 

T  3        Sometimes  shows  an  appreciation  for  work. 
U  Seldom  accepts  direction. 

D  2        Exhibits  a  negative  attitude  towards  Art. 
E  Often  reluctant  to  accept  direction  or  instruction. 

II  S  5        Locates  materials    quickly     and    settles  to  work  without 
E  direction. 

T  4        Locates  materials  but  occasionally    needs     direction  to 
settle  to  work. 

U  3  needs  assistance  to  locate  material  and  needs 
P  supervision  to  get  started. 

2        Reluctant  to  locate  material  and  needs  several  reminders 
to  get  started. 

III  5        Self-disciplined,         involves        oneself      quickly  and 
S     O  effectively.     Stays  on  task. 

T  N  4  Generally  works  well,  sometimes  needs  a  reminder  to 
A  start,  often  on  task. 

Y  T  3  Needs  assistance  during  lesson  to  stay  on  task.  Easily 
I    A  distracted. 

N  S  2  Needs  constant  reminders  to  get  started  and  stay  on 
G    K  task. 


IV  P 
R 
0 
J 
E 
C 
T 


5        Work    is  completed  on  time  and  effort  has  been  put  into 
pro j  ect . 

4        Work  is  completed  on  time  but  more  care  needed. 
3        Work  is     seldom    completed    on  time  and  work  is  often  of 
poor  quality. 

2        Assignments     are     frequently    incomplete      and    work  is 
sloppy. 


V 


5         Involves  oneself  quickly,   does  a  thorough  job     and  helps 

others  when  finished. 
4        Gets  to  work  quickly,  may  forget  one  thing  to  clean  up. 
3        Needs     a  reminder  to  get  started,  often  leaves  something 

for  someone  else  to  clean  up. 
2        Often  involved    in    problem     situations  during  clean  up, 

needs  constant  supervision. 
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SUGGESTED  CRITERIA  FOR  MARKING  A  CONTOUR  SKETCH 
(single  short  lesson) 


-drawing  is  a  reasonable  size  1 

-90/10     contour  lines     evident  3 

(90%  looking  at  objects  -  10%  looking  at  object) 

-neatness  and  craftsmanship  1 

5 

Marking  a  drawing  (realistic  e.g.,   animals)  2 
(final  project  following  a  series  of  lessons  on  contour 
and  gesture  drawing) 

-  proportions  of  animal  are  reasonably  accurate  2 

-  evidence  of  foreground  and  background  2 

-  media  used  well  2 

-  neatness  and  craftmanship  2 

10 

Marking  a  painting,   e.g.,  watercolor  painting 

(final  painting  after  a  series  of  individual  lessons) 

-  evidence  of  graded  and  flat  washes  2 

-  evidence  of  areas  left  white  in  composition  2 

-  evidence  of  different  brush  strokes  2 

-  dark  and  light  values  used  for  contrast  2 

-  general  aesthetic  feeling  of  painting,  neatness 

and  craftmanship  2 

10 

Marking  a  wire  sculpture 

(final  project  following  a  series  of  lessons  on 
handling  wire) 

-  strong  armature  2 

-  joints  are  secure  2 

-  wrapping  used  to  show  mass  2 

-  sculpture  shows  movement  2 

-  centre  of  interest  developed  in  sculpture  2 

10 

Marking  a  printmaking  project  (stencils) 

-  stencil  design  simplified  1 

-  stencil  carefully  cut  1 

-  evidence  of  clear  print  2 

-  repeated  pattern  or  design  shows  thought  2 

-  effort  and  workmanship  2 

8 

Marking  a  printmaking  project  ( styrof cam  or  relief) 

-  initial  drawing  shows  skill  and  thought  2 

-  evidence  of  shapes  and  overlapping  background  to 
foreground  2 

-  textures  are  varied  2 

-  evidence  of  clear  print  (proper  amount  of  ink 

applied  to  plate  2 

-  neatness  and  craftmanship  _2 


10 
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DIAGNOSTIC  ART  TEST 
GRADE  2 


PART  A  -  ELEMENTS  AND  PRINCIPLES 
VALUE  - 15 

PARTB-  CONCEPT  RECOGNITION 
VALUE .  10 

PART  C  -  REFLECTION 
VALUE- 6 

PART  D  -  SKILL  RECOGNITION 
VALUE- 9 

PARTE  -  EXPRESSION 
VALUE  - 10 


TOTAL  VALUE -50 


TEACBOERS  ARE  ASKED  TO  READ  THE 
QUESTIONS  TO  THE  CLASS 


NAME 


SCHOOL 
GRADE 
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1. 


PART  A  -  ELEMENTS  AND  PRINCIPLES 

a)  Draw  a  line  b)  Draw  a  square 


c)  Draw  an  organic  shape  d)  Draw  an  overlapping  shape 


e)  Draw  or  make  a  texture  f)  Draw  a  cube 


78 


2.    Complete   the   following  questions   by  filling  in   the  .  blanks.  You 
may  choose  your  answers  from  the  colors  in  the  box. 
Colors  may  be  used  more  than  once. 


purple 

black 

yellow         green  white 

red 

gray 

blue         orange  brown 

a)    What  are  the  primary  colors? 


Value   

3 


b)    What  two  colors  do  you  mix  to  make: 

 +  =  green 

 +  =  orange 

 +  =  purple 


Value 


TOTAL  VALUE  

15 
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PART  B  -  CONCEPT  RECOGNmON 


Make  an  X  on  the  YES  if  the  sentence  is  right  or  make  an  X  on 
the  NO  if  the  sentence  is  wrong. 

1.    a)    Natural  objects  such  as  trees,  rocks,  grass,  YES  NO 

and  clouds  have  patterns  and  make  patterns. 


b)    The  four  basic  shapes  CANNOT  be  found  YES  NO 

everywhere  in  the  environment,  i.e.,  square, 
rectangle,  triangle,  circle. 


c)    Texture  is  the  feel  roughness  or  smoothness  YES  NO 

of  an  object. 


d)    Primary  colors  can  be  mixed  to  make  new  colors.  YES  NO 


e)    Black  and  white  CANNOT  be  used  to  change  YES  NO 

the  value,  lightness  or  darkness,  of  a  color. 


f)  Light  and  dark  colors  affect  contrast.  YES  NO 

g)  Shapes  can  be  organic  or  geometric.  YES  NO 


h)    A  horizon  line  can  be  used  to  divide  the  YES  NO 

sky  from  the  ground. 


i)    An  x-ray  view  shows  the  inside  of  an  object.  YES  NO 


j)    A  continuous  line  drawing  is  one  way  to  YES  NO 

show  what  we  see. 


TOTAL  VALUE  

10 
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PART  C- REFLECTION 

1.  Look  at  picture  3.18  from  Art  Images,  Grade  3,  and  answer  the 
following  questions. 

a)  How  many  trees  are  in  this  picture?   

b)  How  many  people  are  playing  hockey  in   

this  picture? 

c)  What  season  of  the  year  is  it  in  this  picture?   

VALUE   

3 

2.  Which  are  closest  to  you;   the  children  leaning  on  the  fence,  or 
the  buildings? 


VALUE   

1 

3.    Do  you  see  something  moving  in  the  picture?      YES   NO 

What?  


VALUE -1  Score 


4.    I  feel    when  I  look  at  this  picture. 

(Please  give  a  one-word  answer.)  Why?  This  can  be  a  class 
discussion.  (There  are  no  marks  for  the  class  discussion.) 

VALUE- 1  Score 


TOTAL  VALUE  

6 
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PART  D  -  SKILL  RECOGNITION 


1.    Place  the  letter  for  each  picture  on  the  blank  opposite  the  words 
that  show  the  clearest  example. 

 outhne  drawing 

 gesture  drawing 

 continuous  line  drawing 

 high  detail  drawing 


VALUE 


2.    Place  one  of  the  letters  for  each  picture  on  the  blank  opposite 
the  words  that  show  the  clearest  example. 

 drawing 

 painting 

 printmaking 

 sculpture 

 weaving 
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PART  E  -  EXPRESSION 


1.  You  may  use  your  pencil  or  pencil  crayons  to  do  this  question. 
Make  a  drawing,  on  the  next  page,  to  show  what  is  happening  in 
the  following  paragraph. 

Some  children  are  playing  on  the  school 
playground.  Some  are  playing  tag,  some  hopscotch , 
and  some  are  playing  with  balls  and  skipping 
ropes.  Others  are  on  the  slide,  swings,  and 
climbing  equipment.  What  do  you  like  to  do  when 
you  are  out  on  the  playground? 
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Score  1  point  each  for: 

size  relationship    overlapping  _____  originality 

repetition  or  pattern   line  variety  


VALUE  _ 
5 
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2.  You  may  use  your  pencil  or  pencil  crayons  to  do  this  question. 
Carefully  observe  your  shoe  and  draw  it  as  accurately  and  with  as 
much  detail  as  possible. 

Score  1  point  each  for: 

line  variety    technique    accuracy   

detail  texture  


VALUE    TOTAL  VALUE   

5  18 

TOTAL  SCORE 
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PART  E  -  EXPRESSION 

You  may  use  your  pencil  or  pencil  crayons  to  do  this  question. 
Carefully  observe  your  shoe  and  draw  it  as  accurately  and  with 
as  much  detail  as  possible. 

Score  1  point  each  for: 

Line  Variety          Technique   Accuracy  

Detail   Texture 


TOTAL  VALUE -5 
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TOTAL  SCORE 


DIAGNOSTIC  ART  TEST 
LEVELS 


PART  A  -  ELEMENTS  AND  PRINCIPLES 
VALUE -15 

PARTE-  CONCEPT  RECOGNITION 
VALUE  - 10 

PARTC-  REFLECTION 
VALUE  -  10 

PARTD-  SKILL  RECOGNmON 
VALUE- 5 

PARTE-  EXPRESSION 
VALUE  - 10 


TOTAL  VALUE -50 


TEACHERS  MAY  READ  THE  QUESTIONS  TO  THE  CLASS 


NAME 


SCHOOL 
GRADE 


Annan  Earl 
Arts  Consultant 
Alberta  Education 
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PART  A  -  ELEMENTS  AND  PRINCIPLES 

Place  the  correct  letter  on  the  line  next  to  the  phrase  that  shows 
the  best  example. 

1.    a)  Repeating  pattern.  


b)  Radial  structure,  or  balance. 

c)  Symmetrical  balance.  

d)  Basic  shapes.  


TOTAL_ 
S 
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PART  B  -  CONCEPT  RECOGNmON 


The  following  statements  can  be  TRUE  of  FALSE.  If  you  think  the 
statement  is  true,  write  YES  in  the  blank.  If  you  think  it  is 
not,  write  NO  in  the  blank,  (concepts) 


1.    a)  Weather  conditions  like  fog,  rain,  and  bright  sun 
affect  the  way  we  see  an  object. 


b)  The  style  of  an  art  work  affects  how  we  feel  about  it. 


c)  Natural  forces  such  as  water,  wind,  and  temperature 
can  change  the  shape  of  an  object  over  a  period  of  time. 

d)  When  you  look  at  an  object  closely,  you  may  look  at 
its  shape,  color,  texture,  and  value. 

e)  This  picture  shows  object  A  changing  into  a  different 
object  in  B  and  C. 


f)  This  object  is  being  viewed  from  below. 


g)  Artists  use  related  lines,  shapes,  colors,  and 
textures  to  create  unity  in  their  work. 
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h)  There  is  one  shadow  cast  from  this  box. 


i)  The  direction  and  slant  of  a  line  or  shape 

determines  whether  it  looks  like  it  is  stationary  or  moving. 


j)  The  style  of  an  artwork  does  not  affect  its  emotional 
impact. 


TOTAL_ 
10 
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PART  C  -  REFLECTION 


Look  at  pictures  5.5,  5.17,  and  5.25  from  Art  Images,  Grade  5,  and 
answer  the  following  questions. 

1.    a)  Who  is  the  artist  in  picture  5.5?   

b)  Who  is  the  artist  in  picture  5.17?   


c)  What  technique  was  used  to  produce  picture  5.25? 


a)  What  kinds  of  shapes  are  used  in  picture  5.25?     Underline  the 
correct    answers    from    this    list:       realistic       -  abstract 
geometric     -  organic. 

b)  What  color  scheme  is  dominant  in  picture  5.5?  Underline  the 
correct  answer  from  this  Kst:  primary  -  secondary  - 
analagous. 

c)  Which  picture  is  the  best  example  of  background,  middleground, 
and  foreground?    Put  the  number  on  the  line.   

d)  What  kind  of  balance,  symmetrical,  or  asymmetrical  has  been 
used  in  picture  5.17? 


e)  Where  is  the  greatest  contrast  found  in  picture  5.5?  Between 
the  and  the 


3.    What  emotion  do  you  feel  when  you  look  at  picture  5.5? 


4.    Which  picture  do  you  like  best?    5.5   ;    5.17   ;  5.25 

Why?   


VALUE  _ 
10 
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PART  D  .  SKILL  RECOGNITION 


1.    Place  one  of  the  letters  by  each  picture  on  the  blank  opposite  the 
words  that  show  the  clearest  example. 

  contour  drawing 

  gesture  drawing 

  hatching  and  crosshatching 

  high  detail  drawing 

  modeled  drawing  /\ 


VALUE _ 
5 
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You  may  use  your  pencil  or  pencil  crayons  to  do  this  question.  Make  a 
drawing  to  show  what  is  happening  in  the  following  paragraph. 

Some  children  are  having  fun  playing  on  the 
equipment  in  a  playground,  A  sidewalk  is  in  front 
of  the  children  ana  some  bushes  and  tall  trees  are 
behind  the  children.  There  are  some  clouds  in  the 
sky. 
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Score  1  point  for  each  of: 

Movement  ^   Foreground/middleground/background  _ 

Value  (dark  &  light)    Texture   Balance 


VALUE. 
5 
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You  may  use  your  pencil  or  pencil  crayons  to  do  this  question. 
Carefully  observe  your  shoe  and  draw  it  as  accurately  and  with  as 
much  detail  as  possible. 

Score  1  point  for  each  of: 

Line  variety    Technique    Accuracy  


Detail  Texture 


VALUE  _ 
5 
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SECONDARY  DIAGNOSTIC  ART  TEST 
GRADES  7-12 


PART  A  Elements,  Principles,  Concepts 

PART  B  Self-analysis  Art  Work 

PART  C  Critiquing 

PARTD  Application 


NAME: 

SCHOOL: 

GRADE: 


MARKS 

PART  A  (25) 

PARTB  (12) 

PARTC  (38) 

PARTD  (25) 

TOTAL   . 

Possible  100 
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SECONDARY  DIAGNOSTIC  ART  TEST 
GRADES  7-12 


PART  A:  Elements,  Principles,  and  Concepts 
MULTIPLE  CHOICE 


1.     The   character   of   a   surface   depicted  by   the   arrangement   of   lines  and 
marks  in  a  drawing  is  known  as : 

a.  space  c.  texture 

b.  value  d,  mood   


2.  Tertiary  colors  are  created  by  using: 

a.  primary  colors  c.     secondary  colors 

b.  a  triad  d.     a,  b,  and  c 

3 .  Which  of  the  following  conditions  can  be  expressed  visually? 

a.  social  c.  political 

b.  economic  d.     a,  b,  and  c 


On  the  color  wheel,  red,  yellow,  and  blue  form  a    color  scheme? 

a.  analogous  colors  c.     a  triad 

b.  complementary  d.  monochromatic   


5.  An  analytical  description  of  an  object  is  best  achieved  by: 

a.  gesture  drawing  c.     high  detail  drawing 

b.  outline  drawing  d.    blind  contour  drawing 

6 .  Harmony  involves : 

a.  rhythm- repetition- emphasis         c.     economy- color 

b.  dominance -proportion  d.  balance-proportion 

7.  A  sense  of  depth  can  be  created  by: 

a.  texture  c.  overlapping 

b.  balance  d.     a,  b,  and  c 

8.  Variety  is  best  achieved  through  the  principles  of: 

a.  contrast-elaboration 

b.  rhythm- repetition 

c.  positive  and  negative  shapes 

d.  space  and  value 
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9.     Mood/emotion  in  an  art  work  can  be  affected  by  the  use  of: 

a.  values  c.  line 

b.  contrasts  d.     a,  b,  and  c 

10.  SyTometrically ,  asjrmmetrically ,  and  radial  are  all  forms  of: 

a.  balance  c.  dominance 

b.  space  d.  unity 

11.  The  following  are  not  principles  of  design. 

a.  balance  and  movement  c.     line  and  shape 

b.  rhythm  and  repetition  d.     emphasis -proportion 


12.    A  feeling  of  movement  is  achieved  by  the  repetition  of  lines,  shapes 
colors,  etc.  is  known  as: 

a.  unity  c.  rhythm 

b.  dance  d.  music   


13.     Colors  can  be  made  to  appear: 

a.  political 

b.  to  advance  or  recede  according  to  the  colors  around  them 

c.  economic  or  social 

d.  a,  b,  and  c 


14.     The  organization  of  all  elements   and  principles   that  make  up  a  work 
of  art  is  known  as: 

a.  style  c.  m^dia 

b.  meaning  d.  unity   


15.     Subject  choice,  media  selection,   and  design  element  emphasis  are  used 
to  express: 

a,  meaning  d.  personal  preference 

b.  emotion  d.  a,  b,  and  c   


16.     Creativity  in  an  art  work  can  sometimes  be  enhanced  by: 

a.  copying  the  work  of  others 

b.  accidental  occurrences 

c.  following  an  outline 

d .  a ,  b ,   and  c 
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17.     The  style  of  an  art  work  depends  on  the  artist's  choice  of  color  and 
other  elements : 


a.  affects  how  we  feel  about  it 

b.  depends  upon  the  artist's  choice  of  clothing 

c.  depends  on  how  the  work  is  displayed 

d.  b  and  c 


18.     An  object  can  be  examined  analytically  to  see  how  the  whole  is  made 
up  of  its  parts  by  looking  at: 

a.  color,  shape,  texture,  values 

b.  balance,  overlapping,  repetition 

c .  unity 

d.  a  and  b   
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This  picture  shows  object  A  changing  into: 


a.  a  different  object 

b.  an  alternate  position 


c.  metamorphosis 

d.  a  and  c 


20.     This  object  is  being  viewed  from: 


a.  below  c.     straight  on 

b.  above  d.     none  of  the  above 

21.     The  following  illustration  is  an  example  of: 


a.  outline  drawing 

b.  gesture  drawing 

c.  modeled  drawing 

d.  high  detail  drawing 
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22.     The  following  illustration  is  an  example  of: 


a.  gesture  drawing 

b.  modeled  drawing 

c.  high  detail  drawing 

d.  continuous  line  drawing 


23.     The  following  illustration  is  an  example  of: 


a.  modeled  drawing 

b.  high  detail  drawing 

c.  continuous  line  drawing 

d.  outline  drawing 
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The  following  illustration  is  an  example  of: 


a.  outline  drawing 

b.  gesture  drawing 

c.  modeled  drawing 


d.     high  detail  drawing 
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The  following  illustration  is  an  example  of: 


a.  outline  drawing 

b .  modeled  drawing 

c.  high  detail  drawing 

d.  gesture  drawing 


Value  =25 


Score  = 
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PART  B:     Self -analysis  of  an  art  work. 


Using  a  representative  painting  from  your  portfolio,  please  assess  it 
using  the  following  questions.  Briefly  explain  your  response  to 
each  question. 


1.     Did  you  have   a  clear   idea  of  what  you  wanted  to   do  before  you 
started  this  work?  YES    NO   


How  did  you  develop  your  idea  before  you  started  this  work? 

Research   

Observation   

Experimentation   

Sketching   

Other  (List  them   

Explanation:  


2.     Did  your  idea  change  as  you  progressed  through  this  project? 
YES    NO   


If  yes,  what  changed? 

Media    Technique 

Message    Materials 

Other  (List  them)   

Explanation:  


3.     Do  you  feel  that  you  had  the  knowledge  and  art  skills  necessary 
to  complete  this  work  to  your  satisfaction?    YES    NO   

What  is  most  succesful? 

Expression    Craftmanship   

Use  of  media    Use  of  materials   

Topic   

Other  (List  them)   

Explanation:  
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What  would  you  change  if  you  were  to  do  a  similar  project? 

Expression    Craf tmanship   

Use  of  media    Use  of  materials   

Topic   

Other  (List  them)   

Explanation:  


How  successful  is  this  work  of  art?  1           2           3__    4    5   

(Least  (Most 
Successful)  Successful) 


In  what  ways  do  you  feel  that  you  grew  as  a  result  of  this 
project?    Check  as  many  ideas  as  apply. 

Knowledge   

Visual  awareness   

Appreciation  of  topic   

Understanding  of  yourself   

Understanding  of  others   

Awareness  of  the  environment  ^  

Cooperation  with  others   

Skill  development   

Skill  in  use  of  materials   

Skill  in  use  of  media   

Planning  skills   

Expressive  skills   

Critiquing  skills   

Problem  solving  skills  

Other  

Explanation:  


Value  =  12 
Score  =   
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PART  C:     Critiquing  -  Description,  Analysis,  Interpretation, 
Judgement 


Using  the  work  of  art  from  Part  B,  please  critique  this  piece  using 
the  following  techniques . 

A.  DESCRIPTION: 

Title   ',  

Size   

Subject  Matter   

Media   

Techniques   


B.  ANALYSIS: 

1.    What  kinds  of  shapes  did  you  use? 

Realistic    Organic  

Abstract    Implied   

Geometric   

Other:  (List  them)  Explain  how  or  where  you  used  each  kind  of 
shape . 


2.     What  color  scheme  did  you  use? 

Triade   

Complementary   

Analagous   

Split  complementary   

Monochromatic   

Other:   (List  them)  Explain  how  or  where  you  used  each  color. 


3.     Describe  the  textural  quality. 

Rough   

Smooth   

Prickly   

Silky   

Grainy   

Other:   (List  them)  Explain  how  or  where  you  used  each  texture. 
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4.     What  kind  of  space  did  you  use? 


Positive   

Negative   

Foreground   

Middleground   

Background  __ 

Other:  (List  them)  Explain  how  or  where  you  used  each  kind  of 
space . 


5 .     What  kinds  of  lines  did  you  use? 

Straight   

Curved   

Broken   

Continuous   

Implied   

Other:  (List  them)  Explain  how  or  where  you  used  each  kind  of 
line . 


6.     How  was  value  used? 

To  create  depth   

Mood   

Emotion   

Variety   

Realism   

Other:   (List  them)  Explain  how  or  where  you  used  value. 


7.  Answer  the  following  questions  that  apply  to  your  art  work, 
a)    How  do  line  and  shape  work  together?  Describe. 
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b)    How  do  value  and  space  work  together?  Describe. 


c)     How  do  color  and  texture  work  together?  Describe. 


d)    Other  combinations  that  are  working  together  in  your  art  work, 
e.g.,  color-space,  shape-value?  Describe. 


8.    Listed  below   are   nine   principles    of   design.       Choose  five 
which  you  feel  are  most  important  in  your  work.     Explain  why. 

a)  Balance   


b)  Repetition 


c)  Rhythm 


d)  Movement 


e)  Emphasis 


f)  Contrast 
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g)  Elaboration 


h)  Economy 


i)  Proportion 


INTERPRETATION: 

a)    How  did  you  create  mood  in  your  art  work?     Use  the  elements 
and  principles  of  design  to  support  your  answer. 


b)    What  were  you  trying  to  express  or  convey  through  your  choice 
of  media,  materials,  images,  and  so  on? 


JUDGEMENT: 

a)    What  problems  did  you  encouter  in  the  use  of:  a)  media  and/or 
technique;  b)  composition?  Explain. 


b)    What  works  best  in  this  piece  of  work?  Explain. 


TOTAL  VALUE  -  50 
SCORE   
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PART  D:    Application  -  Knowledge,  Skill 

Draw  your  hand  incorporating  two  other  objects  into  your  composition 
using  high  detail  drawing  techniques.  Be  as  creative  as  possible  in 
the  relationship  you  present  between  these  forms.  Be  aware  of  lines, 
textures,  etc.  that  you  use  to  describe  the  different  surface 
qualities.  Use  lines  only,  (e.g.,  dotting,  hatching,  crosshatching) , 
to  create  textures,  values,  contrasts,  etc.  You  may  use  the  opposite 
page  of  this  test  for  your  drawing.  Your  drawing  will  be  marked 
according  to  the  following  criteria: 


Least  Successful 


Most  Successful 


Line  Variety 

1 

Technique 

1 

Texture 

1 

Detail 

1 

Originality 

1 

Value  -  25 
Score  = 


ARTTEST/AE/jml 
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COMPLETE  YOUR  DRAWING  ON  TfflS  PAGE 
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